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(54) Recording medium, apparatus and method of recording data on the same, and apparatus 
and method of reproducing data from the recording medium 



(57) In an apparatus and method of reproducing a 
data unit consisting of a stream of packs of main picture 
data, a data unit consisting of a stream of packs of audio 
data, and a data untt consisting of a stream of packs of 
sub-picture data, which recorded on an optical disk (1 0) 
and which are reproducible in the same time slot, repro- 
duction data of the data unit including the sub-picture 
data is Reproduced is reproduced by a sub-picture 
decoder section (62) after reproduction data of the data 



unit induding the audio data and reproduction data of 
the data unit including the video data are simultane- 
ously reproduced by a video decoder section (58) and 
an audio decoder section (60). and after the reproduc- 
tion data of the data unit including the sub-picture, the 
reproduction data of the data unit including the audio 
data and the reproduction data of the data unit including 
the video data are simultaneously reproduced again. 
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Description 

i : 

The present invention relates to a recording 
medium, such as an optical disk, for recording com- 
pressed moving picture data, audio data and the like or 
different kinds of data, an apparatus and method of 
recording data on this recording medium, and an appa- 
ratus and method of reproducing data from the same. 

Recently, optical disk players, which can handle 
moving pictures and play optical disks on which picture 
and audio data are digitally recorded, have been devel- 
oped, and are widely used as players for movie soft- 

• ware, karaoke and so forth. Further, MPEG (Moving 
Picture image Coding Expert Group) standards have 
recently become international standards for a data com- 
pression system lor moving pictures. This MPEG sys- 
tem performs variable length compression of picture 
data.' ' ; . 

The MPEG2 system is now also being' internation- 
ally standardized, so that the system format which 

• matches with the MPEG compression system is defined 
as an MPEG2 system layer. This' MPEG2 system layer 
defines the setting of a transfer start time and a play- 
back start time, expressed by using a reference time, in 
moving picture data, audio data and other data, so that 
those data can be transferred and reproduced synchro- 

; nousty. Playback is normally executed using those inf or* 

: mation. ! 

As optical disks designed for multifarious uses have 
recently become available, it is not suff icient to consider 
only on the synchronism among individual pieces of 
data. ■ 

For educational purposes, such as learning Ian- 
. guages, for example, main picture data as video data 
may present questions to users, While sub-picture data 
such as superimposition may give answers to the users. 
In this case, it is signif icant to show answers after make 
questions. 

Accordingly, it is a primary jobject of the present 
invention to provide a recording medium on which vari- 
ous types of data, such as main picture data, audio data 
and sub-picture data, constructed In a reproducible 
manner, are recorded in such a way that the sub-picture 
data can be reproduced with a predetermined! time 
delay with respect to the main picture data. 

It is a secondary object of the present invention to 
provide a method and apparatus of reproducing data 

'. from a recording medium on which various types of 
data, such as main picture data, audio data and sub-pic- 
ture data, constructed in a reproducible manner, are 
recorded in such a way that the sub-picture data can be 
reproduced with a ! predetermined time delay ; with 
respect to the main picture data. [■ ! 

It is a third object of the present invention to provide 

: a method and apparatus of recording various types of 
data, such as main picture data, audio data and sub-pic- 
ture data, constructed in a reproducible manner, in such 
a way that the sub-picture data can be reproduced with 



a predetermined time delay with respect to the main pic- 
ture data. 

h is a fourth object of the present invention to pro- 
vie! e a method and apparatus of reproducing various 

5 types of data, such as main pcture data, audio data and 
sub-picture data, constructed in a synchronously repro- 
ducible manner, in such a way that the sub-picture data 
can be reproduced with a predetermined time delay, 
preset in a machine, with respect to the main picture 

io data. 

It is a fifth object of the present invention to provkJe 
a method and apparatus of reproducing various types of 
data, such as main picture data, audio data and sub-pic- 
ture data, constructed in a synchronously reproduciWe 

75 manner, in such a way that the sUb-picture data ts repro- 
duced with a delay time arbitrarily set using a menu 
screen, with respect to the main picture data. 

It is a sixth object of the present invention to provide 
a method and apparatus of reproducing various types of 

20 data, such as main picture data, audio data and sub-pic- 
ture data, constructed in a synchronously reproducible 
manner, in such a way that the stb-picture data is repro- 
duced with a delay time, computed from the difference 
between the display start time given in sub-pcture data 

25 for one still picture, and the display end time, with 
respect to the main picture data. 

It is a seventh object of the present invention to pro- 
vide a method and apparatus of displaying picti/es in 
such a way that at the time of reproducing superimposi- 

30 tion data or the like as sub-picture data with an arbitrary 
time delay, with respect to main picture data belonging 
to various types of data, such as main picture data, 
audio data and sub-picture data, constructed in a repro- 
ducible manner, the superimposition data or the Eke 

35 appears as if hidden by a mosaic or filling with black dur- 
ing the delay period. 

To achieve the above object, the present invention 
provides a recording medium comprising a recording 
medium comprising a plurality of data units recorded 

40 thereon, which become objects to be reproduced in a 
time sequential manner, each object being reproduced 
within a given time period; each of the data units being 
constituted of a stream of a plurality of data packs and 
playback time information, the data packs containing 

45 packets of reproduction data including at least one of 
audio data, video data and sub-picture data; the time 
information of that data unit which indudes a sub-pic- 
ture being later by a predetermined time than time infor- 
mation of that data unit which indudes audio data or 

so video data; reproduction data of the data unit including 
the! sub-picture being reproduced after reproduction of 
reproduction data of the data unit inducfing the audio 
data or video data. 

The present invention also provides a recording 

55 apparatus comprising a recording apparatus for record- 
ing reproduction data on a recording medium, compris- 
ing: means for generating a plurality o< data packs and 
playback time information, the data packs containing 
packets of reproduction data inducing at least one of 
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audio data, video data and sub-picture data; means for 
preparing a plurality of. data units including playback . 
tirne information and having a stream of data packs to 
be reproduced within a given time period as a unit; and 
means for recording the data units on the recording s 
medium, in a time-sequentially reproducible manner, 
time information of that data unit which includes a sub- 
picture to be reproduced within the given time period 
being later by a predetermined time than time informa- 
tion of that data unit which Includes audio data or video to 
data to be reproduced within the given time period. 

"i The present invention further provides a method 
comprising a method of recording reproduction data on : 
a recording medium, comprising the steps of: generat- 
: ing a plurality of data packs containing packets of repro- is 
deletion data including at least one of audio data, video 
data and sub-picture data; preparing a plurality of data 
units including playback time information and having a 
stream of data packs to be reproduced within a given 
time period as a unit and recording the data units on 20 
the recording medium in a time-sequentially reproduci- 
ble manner, time information of that data, unit which 
includes a sub-picture to be reproduced within the given 
time period being later by a predetermined time than 
time information of that data unit which includes audio 25 
/ data or video, data to be reproduced within the given 
time period.- : - , ! 

{ The present invention also provides a reproducing 
apparatus comprising a reproducing apparatus for 
reproducing r^roduction data from a recording 30 
medium, comprising: means for acquiring, from the 
recording medium, a plurality of data units recorded 
thereon, which become objects to be reproduced in a 

• time sequential manner; each object being reproduced 
within a given time period, each of the data units being & 
constituted of a stream of a plurality of data packs and 
playback time Information, the data packs containing 
packets of reproduction data including at least one of 
audio data, video data and sub-picture data, time infor- 
mation of that data unit which Includes a sub-picture to 40 
be reproduced within a given time period being later by 
a predetermined time than time Information of that data 
unit which includes audio data or video data to be repro- 
duced within the given time period; and means for con- 
verting the data unit of the acquired reproduction data to <s 

■ a reproduction signal in accordance with the time infor- 
mation included in the ! data unit and reproducing the ; 
production signal, whereby after reproduction data of 
that data unit which includes audio data or video data to 
be reproduced within a given time period is reproduced, so 
the reproducing means ^reproduces reproduction data of 
the data unit Including the sub-picture to be reproduced 
within the given period.' 

The present invention also provides a reproducing 
apparatus , comprising ^ a reproducing apparatus for ss 
reproducing . reproduction data from a recording 

• Medium, comprising: means for acquiring, from the 
recording medium, a plurality of data units recorded 

"•'-I thereon, which become objects to be reproduced in a 



time sequential manner, each object being reproduced 
within a given time period, each of the data units being 
constituted of a stream of a plurality of data packs and 
playback time information, the data packs containing 
packets of reproduction data including at least one of 
audio data, video data and sub-picture data; and means 
for converting the data unit of the acquired reproduction • 
data to a reproduction signal in accordance with the 
time information included In the data unit and reproduc- 
ing the reproduction signal, whereby after reproduction 
data of that data unit which includes audio data or video 
data to be reproduced within a given time period is 
reproduced, the reproducing means reproduces repro- 
duction data of the data unit including the sub-picture to 
be reproduced within the given period when a predeter- 
mined time previously set elapses. : 

The present invention also provides a reproducing 
apparatus comprising a reproducing apparatus for 
reproducing reproduction data from a recording 
medium, comprising: means for acquiring, from the 
recording medium, a plurality of data units recorded 
thereon, which become objects to be reproduced in a 
time sequential manner, each object being reproduced 
within a given time period, each of the data units being 
constituted of a stream of a plurality of data packs and 
playback time information, the data packs containing 
packets of reproduction data including at least one of 
audio data, video data and sub-picture data; means for 
setting a delay time at which reproduction data of that 
data unit which includes a sub-picture to be reproduced 
within a given time period after reproduction data of that 
data unit which includes audio data or video data to be 
reproduced within the given time period is reproduced; 
and means for converting the data unit of the acquired 
reproduction data to a reproduction signal in accord- 
ance with the time information included in the data unit 
and reproducing the reproduction signal, whereby after 
reproduction data of that data unit which includes at 
least one of audio data and video data to be reproduced 
within a given time period is reproduced, the reproduc- 
ing means reproduces reproduction data of the data unit 
Including the sub-picture to be reproduced within the 
given period when the 6et delay time elapses. 

The present invention also provides a reproducing 
apparatus comprising a reproducing apparatus for 
reproducing reproduction data from a recording 
medium, comprising: means for acquiring, from the : 
recording medium, a plurality of data units recorded 
thereon, which become objects to be reproduced in a 
time sequential manner, each object being reproduced 
within a given time period, each of the data units being 
constituted of a stream of a plurality of data packs and 
playback time information, the data packs containing 
packets of reproduction data including at least one of 
audio data, video data and sub-picture data, the time 
information of that data unit which includes a silb-pic- 
ture consisting of a playback start time and playback 
stop time; means for computing a delay time of the data 
unit including the sub-picture from the playback start 
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time and playback stop time recorded in the data unit 
including the sub-picture of the acquired reproduction 
data; and means for converting the data 1 unit of the 
acquired reproduction data to a reproduction signal in 
accordance with the time information included in the 
data unit and reproducing the: reproduction signal, 
whereby after reproduction data of that data unit which 
includes at least one of audio data and video data to be 
reproduced within a given time period is reproduced, 
the reproducing means reproduces reproduction data of 
the data unit including the sub-picture to be reproduced 
within the given period when the' computed delay time 
elapses. 

. This invention can be more fully understood from 
the following detailed description when taken in con- 
junction with the accompanying drawings, in which: 
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FIG. 1 is a schematic block !diagram of an optical 
disk apparatus according to the first embodiment of 
the present invention; . & 
FIG. 2 is adetailed block diagram of the mechanical 
section of the disk drive unit of FIG. 1 ; 
FIG. 3 is a schematic perspective view of the struc- 
ture of an optical disk loaded in the disk drive unit of 
FIG.1; ■ 1 * 

FIG. 4 shows the structure of the logic format of the 
optical disk of FIG. 3; 

FIG. 5 shows the structure of the video manager of 
FIG. 4; 

FIG. 6 shows an example of the structure of the so 
video object set (VOBS) shown in FIG. 5; 
FIG. 7 is a diagram to help explain the structure of ; 
"the video object unit of FIG. 6; 
FIG. 8 shows the parameters and contents of the 
volume manger information management table 35 
(VMGLMAT) in the video manager (VMGI) of FIG. 
5; 

FIG. 9 shows the structure of the title search pointer 
table (TSPT) in the video manager (VMGI) of FIG. 

5; :« 

FIG. 10 shows the parameters and contents of the 

title search pointer table information (TSPTI) in the 

title search pointer table (TSPT) of FIG. 9; 

FIG. 1 1 shows the parameters and contents of the 

title search pointer (TT_SRP) corresponding to the <5 

Input number in the title search pointer table (TSPT) 

of FIG. 9; : 

FIG. 1 2 illustrates the structure of the video title set 

of FIG. 4; | 

FIG. 13 shows the parameters and contents of the so 

video title set information management table 

(VTSLMAT) of the video title set information (VTSI) 

of FIG. 12; ! 

FIG. 14 illustrates the structure of the video title set 

program chain information table (VTS_PGCIT) of 55 

the video title set information (VTSI) of FIG. 12; 

FIG. 15 shows the parameters and contents of the ; 

information (VTS_PGCITI) in the video title set pro- 



gram chain information table (VTS_PGCIT) of FIG. 
14; 

FIG, 16 shows the parameters and contents of the 
search pointer (VTS^PGCtT^SRP) corresponding 
to the program chain in the video title set program 
chain information table (VTS^PGCIT) of FIG. 14; 
FIG. 17 illustrates the structure of the program 
chain information (VTS_PGCI) in the video set cor- 
responding to the program chain in the video title 
set program chain information table (VTS.PGCIT) 
of FIG. 14; 

FIG. 1 8 shows the parameters and contents of the 
program chain general information (PGC_Gi) in the 
program chain information (VTS_PGCI) of FIG. 17; 
FIG. 19 illustrates the structure of a program chain 
map (PGC^PGMAP) of the program chain informa- 
tion (VTS_PGCl) of FIG. 17; 
FIG. 20 shows the parameters ard contents of the 
entry cell numbers (ECELLN) correspond ng to the 
programs written in the program chain map 
(PGC_PGMAP)ofFIG. 19; 
FIG. 21 illustrate the structure of the eel playback 
information table (C_PBIT) of the program chain 
information (VTS J>GCI) of FIG. 1 7; 
FIG. 22 shows the parameters and contents of the 
cell playback information table (C_PB!T) of FIG 21 ; 
FIG. 23 illustrates the structure of the ceD position 
information (C^POSI) in the program chain infor- 
mation (VTS.PGCI) of FIG. 1 8; 
FIG. 24 shows the parameters and contents of the 
cell position information (C_POSl) of FIG. 23; 
FIG. 25 illustrates the structure of the navigation 
pack of FIG. 23; 

FIG. 26 illustrates the structure of the video, audio, 
sub-picture, or VBI pack of FJG. 6; 
FIG. 27 shows the parameters and contents of the 
presentation control information (PCI) in the navi- 
gation pack of FIG. 26; 

FIG. 28 shows the parameters ard contents of the 
general information (PCLGl) in the presentation 
control information (PCI) of FIG. 27; 
FIG. 29 shows the parameters and contents of the 
disk search information (OSI) in the navigation pack 
of FIG. 26; 

FIG. 30 shows the parameters and contents of the 
DSl general information (DSLGI) in the disk search 
information of FIG. 29; 

FIG. 31 shows the parameters and contents of the 
synchronizing playback information (SYNCI) on the 
video cfcject (VOB) of FIG. 29; 
FIG. 32 shows the structure of a sub-picture unit; 
FIG. 33 shows parameters and contents of a sub- 
picture unit header (SPUH) of the sub-picture unit 
shown in FIG. 32; 

FIG. 34 shows the parameters and contents of a 
display control sequence taUe (DCSQT) of the sii>- 
pidure unit shown in FIG. 32; ; •« 
FIG. 35 shows the parameters and contents of a 
display control sequence (DCSQ) sho*n in FIG. 34; 
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] FIGS. 36A through 36L present a timing chart for 
? explaining the relationship among an input clock, 

* output clock, PTS and DTS for use in the reproduc- 
1 tioh of video data, audio data and sut>picture data; 

i FIG. 37 illustrates the structure of the video buffer s 
section shown in FIG. 1; 
: FIG. 38 illustrates [the structure of the video 
: decoder section shown in FIG. 1 ; 
; f(G ; 39 illustrates [the structure of the audio 
. decoder section shown in FIG. 1 ; 10 . 

.: FIG. 40 illustrates the structure of the sub-picture 
? decoder section shown in FIG. 1 ; 
jj FIG. 41 Is a flowchart Illustrating the procedures of 
; reproducing video data, audio data and sub-picture 
/data; ■ ' :| ' . 15 

' FIG; 42 is a flowchart illustrating the detailed repro- 
duction procedures; j 

i FIGS. 43A through 43C show the output states of 
] video data, audio data and sub-picture data in the 
( reproduction process illustrated in FIG. 41 ; 20 

FIG. 44 is a Uod< diagram schematically showing 
I an optical disk apparatus according to the second 
= embodiment of this invention; 
\ FIGS. 45A through 45M present a timing chart for 
/explaining the relationship among an input clock, 25 

* output clock. PTS and DTS for use in the reproduc- 

• tion of video data, audio data and sub-picture data 
adding to this second embodiment; 

; FIG. 46 is a flowchart illustrating the procedures of 

I reproducing video data, audio data and 6ub-picture 30 

i data by the optical disk apparatus shown in FIG. 44; 

; FIGS. 47A and 47B show display examples of a 

; menu on a key/display section according to the third 

j embodiment of this invention; 

; FIG. 48 is a flowchart illustrating the procedures of ss 

}■:• reproducing video data, audio data and sub-picture 

)■•' data according to the third embodiment; 

: FIGS. 49A through 49M present a timing chart for 

■ explaining the relationship among an input clock, 

; output clock, PTS and DTS for use in the reproduc- 40 
i tion of video data, audio data and sub-picture data 

■ according to this fourth embodiment; 

i FIG V 50 is a flowchart illustrating the procedures of 
( reproducing video data, audio data and sub-picture 
/ data by the optical disk apparatus shown in FIG. 48; <ts 

FIGS. 51 A through 51C show the output states of 
s video data, audio data and sub-picture data at the 
; time superimpositioh is displayed after a phrase; 

FIGS. 52A through 52C show the output states of 
f video data, audio data and sub-picture data at the so. 

time of displaying superimposition before freezing 
; the video and audio; 

• FIGS. 53A through 63C show the output states of : 
\ video data, audio data and sub-picture data at the 

: time sounds for only a phrase portion are repro- ss 
i • duced with some; delay and the video image and 
/ sub-picture are frozen; 

; FIGS, 54A through 54C 6how the output states of 
: video data, audio data and sub-picture data at the 
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time the second sound is reproduced with some 
delay and the video image, sub-picture and first 
sound are frozen; 

FIGS. 55A through 55C show the output states of 
video data, audio data and sub-picture data at the 
time the first sound and sub-picture are reproduced 
with some delay and the video image and second 
sound are frozen; 

FIGS. 66A through 56C show the output states of 
video data, audio data and sub-picture data at the 
time the second sub-picture is reproduced with 
some delay and the video image, sounds and the 
first sub-picture are frozen; 
FIG. 57 is a block diagram schematically showing 
an optical disk apparatus according to another 
embodiment; 

FIGS. 58A and 58B show the output states of video 
data, audio data and sub-picture data at the time of 
presenting the mosaic display of sub-pictures for a 
delay time; 

FIG. 59 Is a block diagram of an encoder system 
that encodes the video data and generates a video 
• file; • 

FIG. 60 is a flowchart for an encoding process of 
FIG. 59; 

FIG. 61 is a flowchart for combining the main video 
data, audio data, and sup-picture data all encoded 
according to the fbw of FIG. 60 to create a video 
datafile; 

FIG. 62 is a block diagram of a disk formatter sys- 
tem that records the formatted video files on an 
optical disk; 

FIG. 63 is a flowchart for creating logic data to be 
recorded on a disk in the disk formatter of FIG. 62; 
FIG. 64 is a flowchart for creating from the logic 
data the physical data to be recorded on a disk; and 
FIG. 65 is a schematic diagram of a system that 
transfers the video title set of FIG: 4 via a communi- 
cation route. 

Hereinafter, referring to FIGS. 1 through 43C, an : 
optical disk reproducing apparatus according to the first 
embodiment of the present invention will be explained. 

FIG. 1 is a block diagram of an optica! disk repro- 
ducing apparatus that reproduces the data from an opti- 
cal disk associated with an embodiment of the present 
invention. FIG. 2 is a block diagram of the disk drive sec- 
tion that drives the optical disk shown in FIG. t FIG. 3 
shows the structure of the optical disk 6hown in FIGS. 1 
and 2. 

: As shown in FIG. 1, the optical disk reproducing 
apparatus comprises a key/display section 4, a monitor 
section 6, and a speaker section 8. When the user oper- 
ates the key/display section 4, this causes the recorded 
data to be reproduced from an optical disk 10. The 
recorded data contains video data, sub-picture data, 
and audio data, which are converted into video signals 
and audio signals. The monitor section 6 displays 
images according to the audio signals and the speaker 
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section 8 generates sound according to the audio sig- 



lt is known that the optica! disk 10 is available with 
various structures. For instance, one type of the optica! 
disk 10 is a read-only disk on which data is recorded 
with a high density as shown in FIG. 3. The optical disk 
10, as shown in FIG. 3, is made up of a pair of compos- 
ite layers 18 and an adhesive layer 20 sandwiched 
between the composite disk layers 18. Each of the com- 
posite disk layers 18 is composed of a transparent sub- 
strate 14 and a recording layer or a light-reflecting layer 
1 6. The disk layer 1 8 is arranged so that the light-reflect- 
ing layer 16 may be in contact with the surface of the 
adhesive layer 20. A center hole 22 is made in the opti- 
cal disk 10. On the periphery of the center hole 22 on 
both sides, clamping areas 24 are provided which are 
used to clamp the optical disk 10 during its rotation. 
When the disk 10 is loaded in the optical disk apparatus, 
the spindle of a spindle motor 12 shown in FIG. 2 is 
inserted Into the center hole 22. As long as the disk is 
being rotated, it continues clamped at the damping 
areas 24. . ! 

As shown in FIG. 3, the optical disk 10 has an infor- 
mation zone 25 around the clamping zone 24 on each 
side, the information zones allowing the information to 
be recorded on the optical disk 10. In each information 
area 25. its outer circumference area is determined to 
be a lead-out area 26 in which no information is nor- 
mally recorded, its inner circumference area adjoining 
the clamping area 24 is determined to be a lead-in area 
27 in which no information is normally recorded, and the 
area between the lead-out area 26 and the lead-in area 
27 is determined to be a data recording area 28. 

At the recording layer 16 in the information area 25, 
a continuous spiral track is normally formed as an area 
in which data is to be recorded. The continuous track is 
divided into a plurality of physical sectors, which are 
assigned serial nurribers. On the basis of the sectors, 
data is recorded. The data recording area 28 in the 
information recording area 25 is an actual data record- 
ing area, In which management data, main video data, 
sub-picture data, and audio data are recorded in the 
form of pits (that is, in the form of changes in the physi- 
cal state) as explained later. With the read-only optical 
disk 10, a train of pits is previously formed in the trans* 
: parent substrate 14 by a stamper, a reflecting layer is 
formed by evaporation on the surface of the transparent 
substrate 14 in which the pit train is formed, and the 
reflecting layer serves as the recording layer 16. In the 
read-only optical disk 10, a groove is normally not pro- 
vided as a track and the pit train in the surface of the 
transparent substrate 1 4 serves as a track. 

The optical disk apparatus 12, as shown in FIG. 1. 
further comprises a cfisk drive section 30, a system CPU 
section 50. a system ROM/RAM section 52, a system 
processor section 54, a data RAM section 56, a buffer 
control STC control section 57, a video decoder 58, a 
video buffer section 59, an audio decoder section 60. an 
audio buffer section 61, a sub-picture decoder section 



62, a sub-picture buffer section 63, a mixing section 64, 
a video D/A section 66 and an audio D/A section 68. 

As shown in FIG. 2. the disk drive section 30 con- 
tains a motor driving droit 1 1 , a spindle motor 12. an 
5 optical head 32 (i.e.. an optical pickup), a feed motor 33, 
a focus circuit 36, a feed motor driving circuit 37, a track- 
ing circuit 38. a head amplifier 40, and a servo process- 
ing circuit 44. The optical disk 10 is placed on the 
spindle motor 12 driven by the motor driving circuit 11 
10 and is rotated by the spindle motor 1 2. The optical head 
32 that projects a laser beam on the optical disk 10 is 
: located under the optical disk 1 0. The optical head 32 is 
placed on a guide mechanism (not shown). The feed 
motor driving circuit 37 is provided to supply a driving 
15 signal to the feed motor 33. The motor 33 is driven by 
the driving signal and moves in and out the optical head 
32 across the racfius of the optical disk 10. The optical 
head 32 is provided with an object lens 34 positioned so 
as to face the optical risk 10. The object lens 34 is 
20 moved according to the driving 6ignal supplied from the 
focus circuit 36 so as to move along Hs optical axis. 

To reproduce the data from the above optical disk, 
the optical head 32 projects a laser beam on the optica! 
disk 10 via the object lens 34. The object lens 34 is 
25 moved Bute by little across the radius of the optical disk 
10 according to the driving siQnal supplied from the 
tracking circuit 33. Furthermore, the object lens 34 s 
mewed along its optical axis according to the driving sig- 
nal supplied from the focusing circuit 36 so that its tocal 
30 point may be positioned on the recording layer 1 5 of the 
optical disk 10. This causes the laser beam to toon the 
smallest beam spot on the spiral track (he., the pft train), 
enabling the beam spot to trace the track The laser 
beam is reflected from the recording layer 16 and 
35 returned to the optical head 32. The optical head 32 
converts the beam reflected from the optical disk 1 0 into 
an electric signal, which is supplied from the optical 
head 32 to the servo processing circuit 44 via the head 
arrpW ier 40. From the electric signal, the servo process- 
40 ing circuit 44 produces a focus signal, a tracking signal, 
and a motor control signal and supplies these signals to 
the focus circuit 36, tracking ctroit 38, and motor dr'rving 
circuit Irrespectively. 

Therefore, the object lens 34 is moved along its 
45 optical axis and across the radius of the optical disk 1 0. 
its focal point is positioned on the recording layer 16 of 
the optical disk 1 0, and the laser beam forms the smal- 
est beam spot on the spiral track. Furthermore, the spin- 
dle motor 12 is rotated by the motor driving droit 1 1 at 
so a specific rotating speed. This allows the beam to track 
at, for example, a constant linear speed. 

The system CPU section 50 of FIG. 1 supplies to 
the servo processing circuit 44 a control signal serving 
as an access signal. In response to the control signal. 
55 the servo processing droit 44 supplies a head-moving 
signal to the feed motor driving drort 37, which sup- 
plies a driving signal to the feed motor 33. Then, the 
feed motor 33 is driven, causing the optical head 32 to 
move across the radius of the optical disk 10. Then, the 
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optical head 32 accesses a specif ic sector formed at the 
recording layer 16 of the optical disk 10. The data is 
reproduced from the specific sector by the optical head 
32, which then supplies it to the head amplifier 40. The 
head amplifier 40 amplifies the reproduced data, which; 
is outputted at the disk drive section 30. 
:i i The reproduced data is transferred and stored in a 
data RAM section 56 by the system processor section 
54 which is controlled by the system CPU section 50 
which is operated in - accordance with the programs 
stored in the system ROM/RAM section 52. The stored 
reproduced data is processed at the system processor 
section 54, which sorts the data into video data, audio 
data, and sub-picture data. The video data is sent via 
the video buffer section 59 to the video decoder section 
58 to be decoded, the audio data is sent via the audio 
buffer section 81 to the audio decoder section 66 to be 
decoded, and the sub-picture data is sent via the sub- 
picture buffer section 63 to the sub-picture decoder sec- 
tion 62 to be decoded.- The decoded video data and 
sub-pictitfe data are mixed by the mixing section 64, 
and the resultant data is converted to an analog video 
signal by the video D/A section 66. TWs analog video 
signal is then sipplied to the monitor section 6. The 
audio data is converted by the audio D/A section 68 to 
an audio signal which Is supplied to the speaker section 
8iThen ( on the basis of the video signal, an image is 
displayed on the monitor section 6 and according to the 
audio signal, sound is simultaneously reproduced from 

the speaker section 8. \ 
5 The detailed operation of the optical disk apparatus 

of FIG. 1 will be described later with reference to the 
logic format of the optical disk explained below. 

<■ The data recording area 28 between the lead-in 
a^ea 27 and the lead-out area 26 on the optical disk of 
FIG. 1 has a volume and file structure as shown in FIG. 
4. The structure has been determined in conformity to 
specific logic format standards, such as Micro UDF or 
ISO 9660. The data recording area 28 is physically 
divided into a plurality of sectors as described earlier. 
These physical sectors are assigned serial nunrtbers. In 
. the following explanation, a logical address means a 
logical sector number (LSN) as determined in Micro 
UDF or ISO 9660. Like aphysical sector, a logical sector 
contains 2048 bytes. The numbers (LSN) of logical sec- 
tors are assigned consecutively in ascending order as 
the physical sector number increments. 

* As shown In FKSL 4, the volume and file structure is 
a hierarchic structure and contains a volume and f Be 
structure area 70, a video manager 71, at least one 
video title set #i 72, and another recorded area 73. 
These areas 70, 71 , 72, 73 are aligned with the bound- 
aries between logical sectors. As with a conventional 
CD. a logical sector is;defined as a set of 2048 bytes. 

. Accordingly, one logical sector corresponds to one logi- 
cal block. :"...}' 

• The volume and file structure area 70 corresponds 
to a management area determined in Micro UDF or ISO 
9660. According to the description in the management 



: area, the video manager 71 is stored in the system 
ROM/RAM section 52. As explained with reference to 
FIG. 5, the information used to manage video title sets 
72 is written in the video manager 71, which is com- 
5 posed of a plurality of files, starting with file #0. In each 
video title set 72, compressed video data, compressed 
audio data, compressed sub-picture data, and the 
reproducing information about these data items are 
stored as explained later. Each video title set is corn- 
to posed of a plurality of files 74. The number of video title 
sets 72 is limited to a maximum of 99. Furthermore, the 
nurrter of files 74 (from file #j to file #j+9) constituting 
each video title set 72 is determined to be a maximum 
of 10. These files 74 are also aligned with the bounda- 
1S ries between logical sectors. 

In the other recorded area 73, the information capa- 
ble of utilizing the aforementioned video title sets 72 is 
recorded. The other recorded areas 73 are not neces- 
sarily provided. ; : 
20 As shown in FIG. 5, the video manager 71 contains 
at least three Hems each corresponding to individual 
files 74. Specifically, the video manager 71 is made up 
.'. of volume manager information (VMGl) 75. a video 
object set for video manager menu (VMGM _VOBS) 76, 
25 and backup of video manager information (VMGLBUP) 
77. Here, the volume manager information (VMGl) 75 
and the backup of video manager information 
(VMGLBUP) 77 are determined to be indispensable 
Hems, and the video object set for video manager menu 
30 (VMGM VOBS) 76 is determined to be an optional 
item. Inlhe video object set 76 for VMGM, the video 
data, audio data, and sup-picture data about a menu of 
the volumes of the optical disk managed by the video 
manager 71 are stored. w :.oti 
35 By the video object set 76 for VMGM 
(VMGMJ/OBS), the volume name of the optical disk 
10, the sound accompanying the volume name repre- 
sentation, and the description of the sub-picture are dis- 
played and at the same time, selectable items are 
40 provided in the form of sub-pictures as in video repro- 
duction explained later. For example, the video object 
set 76 tor VMGM (VMGMJ/OBS) indicates that the 
optical disk 10 contains the video data representing 
English conversation for learning English. Specifically. 
45 lessons on English conversation, together with a vol- 
ume name, such as the contents of English conversa- 
tion, is reproduced in the form of video data and at the 
6ame time, a theme song is reproduced in sound, and 
the level of the teaching material is displayed in a sup- 
so picture. Furthermore, the user is asked which one of 
lessens 1 to N to select Thus, for example, the VMGM 
video object set 76 (VMGM_VOBS) provides the user 
with preparations to watch an English conversation pro- 
gram for learning English. 
55 Here, the structure of a video object set (VOBS) 82 
will be described with reference to FIG. 6. FIG. 6 shows 
an example of a video object set (VOBS) 82. The video 
object set (VOBS) 82 comes in three types for two 
menus and a title. Specifically, the video object set 
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(VOBS) 82 contains the video title set for video manager 
menu (VMGM_VOBS) 76. a| video object set 
(VTSM.VOBS) 95 for a menu in the video title sets 72 
and a video object set (VTSTTVOBS) 82 for the titles 
of at least one video title set 72 in a video title set (VTS) 
72 as explained later. Each videoobject set 82 has the 
same structure except that their uses differ, j I 

As shown in FIG. 6. a video object set (VOBS) 82 is 
defined as a set of one or more video objects (VOB) 83. 
The video objects 83 in a video object set (VOBS) 82 is 
used for the same application.! A video object set 
(VOBS) 82 for menus is usually made up of one video 
object (VOB) 83 and stores the data used to display a 
plurality of menu screens. In contrast, a video object set 
(VTSTT_VOBS) 82 for title sels is usually composed of 
a plurality of video objects (VOB) 83. j 

When the aforementioned video of an English con- 
versation program for learning English is taken as 
example, a video object (VOB) 83 corresponds to the 
video data of each lessen. Specifying a particular video 
object (VOB) 83 enables, for example, lesson 1 to be 
reproduced on a video. ; The video j object set 
(VTSM_VOBS) 95 for a menu of the video tMe sets 72 
contains the menu data for the English conversation. 
According to the presentation of the menu, a particular 
lesson, for example, lesson t, can be specified. In the 
case of a usual single story movie, one video object 
(VOB) 83 corresponds to one video object set (VOBS) 
82. One video stream is completed with one video 
object set (VOBS) 82. In the case of a collection of ani- 
mated cartoons or an omnibus; movie, a plurality of 
video streams each corresponding to individual stories 
are provided in a single video dbject set (VOBS) 82. 
Each video stream is stored in the corresponding video 
object 83. Accordingly, the audio stream and sub-pic- 
ture stream related to the video stream are also com- 
pleted with each video object (VOB) 83. 

An identification number (IDN#j) is assigned to a 
video object (VOB) 83. By the identification nurrtber 
(IDflj), the video object (VOB) 83 can be identified. A 
video object (VOB) 83 further comprises one or more 
such cells 84. Although a usual video stream Is made up 
of a plurality of cells 84. a menu video stream, or a video 
object (VOB) 83 may be composed of one cell 84. A cell 
84 is likewise assigned an identification number 
(CJDN#j). By the identification number (CJDN#j), the 
cell 84 is identified, i 

As shown in FIG. 6, each cell 84 is composed of 
one or more video object units (VOBU) 85. normally a 
plurality of video object units (VOBU) 85. Here, a video 
object unit (VOBU) 85 is defined as a pack train having 
a navigation pack (NAV pack) 86 at its head. Specifi- 
cally, a video object unit (VOBU) 85 is defined as a set 
of all the packs recorded, starting at a navigation pack 
(NAV pack) 86 to immediately in front of the next naviga- 
tion pack. The reproducing time of the video object unit 
(VOBU) 85 corresponds to the reproducing time of the 
video data made up of one or more GOP (Group of Pic- 
tures) contained in the video object unit (VOBU) 85 as 

.i i t 



shown in FIG. 6. The maximum reproducing time is 
determined to be 0.4 or more second and less than one 

. second. In MPEG, one GOP is defined as compressed 
image data which corresponds to about 1 5 frames ta be 

5 played back for, usually 0.5 seconds. 

h the case where the video data includes a video 
object unit as illustrated in FIG 6. GOPs each com- 
posed of a video pack (V pack) 88. a sub-pictue pa* 
(SP pack) 90 and an audio pack (A pack) 91 . all compe- 
te* ing to the MPEG standards, are arranged, producing a 
vide data stream. Regardless of the number of GOPs. a 
video object (VOBU) 83 is determined based on the 
time required for producing a GOP. In the video object 
(VOBU) 83 has a navigation pack (NV) pack 86 

15 arranged at its head. Any reproduced data, whether 
audio data, sub-picture data, or audio/sub-p*cture data, 
consists of one more video object units. Thus, even rf a 
video object unit is composed of only aucfio packs only, 
these audio packs will be reproduced within the time for 

20 reproducing the video object unit The procedure of 
reproducing these packs will be explained later in detaB, 
along with the procedure of reproducing the navigation 
pack (NV pack) 86. 

The procedure for reproducing these parte. 

25 together with the navigation pack, will be explained in 
detaB later. ! 

The video manager 71 will be explained with refer- 
ence to FIG. 5. The volume management information 75 
placed at the head of the video manager 71 contains the 

30 information used to search for titles and the hformat'on 
used to manage the video title sets (VTS) 72 such as 
the information used tor reproduction of a video man- 
ager menu. The volume management information 75 
contains at least three tables 78, 79. 80 in the order 

35 shown in FIG. 5. Each of these tables 78. 79. 80 is 
aligned with the boundaries between logical sectors. A 
first table 78. a volume manger information manage- 
ment table (VMGLMAT) 78 is a mandatory tabfe, in 
which the size of The video manager 71. the starting 

40 address of each piece of the information in the video 
manger 71, and the attrftxrte Information about the 
video object set (VMGM_VOBS) 76 tor a video manager 
menu are written. j 

Written in a second table of the video manager 71. 

is a title search pointer table 79 (TT_SRPT). is an entry 
program chain (EPGC) of the video titles (VTS) 72 con- 
tained in the optical disk 10 that are selectable accord- 
ing to the entry of a title number from the keyWisplay 
section 4 on the apparatus. 

so Here, a program chain 87 is a set of programs 89 
that reproduce the story of a title as shown in FIG. 7. 
Continuous reproduction of a program chain 87 com- 
pletes an educational program such as English conver- 
sation for learning English of a title. Therefore, the user 

55 can start to see the English conversation from a partic- 
ular scene of the conversation by specifying the pro- 
gram 89. 

tn a third table of the video manager 71 . a video title 
set attribution table (VTS_ATRT) 80, the attrfoute infer- 
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mation determined in the video title $et 72 in the volume 
of the optical disk 10 is (written. Specifically, in this table 
72, the following items are written as attribute informa- 
tion: the number of video' title sets, video title set num- 
bers, video - attributes. 1 such as a video data 
compression scheme, audio stream attributes, such as 
an audio coding mode, and sub-picture attributes, such 
as the type of sup-picture display. 

• The contents of the 1 volume manager information 
management table (VMGI.MAT) 78 and the title search 
pointer table (TTSRPT) 79 will be explained In detail 
with reference to FIGS. 8, 9, 10, and 11. 
'.. j As shown In FIG. 8. written In the volume manager 
Information management table (VMGI_MAT) 78 are a 
video manager identifier (VMGJD). the size of video 
manager information (VMGI_SZ) logical blocks (one 
logical block contains 2048 bytes as mentioned above), 
the version number (VERN) of the optical disk 10 com- 
plying with the digital versatile disk (DVD) video specifi- 
cation, and the category of video manager 71 

(VMG_CAT). '■■ . - 1 

i In the category of video manager 71 (VMG_CAT), a 
flag indicating whether or not the DVD video directory 
prohibits copying is written. Further written in the table 
(VMGI_MAT) are a volume set identifier (VLMSJD). the 
number of video title sets (VTS_Ns), the identifier for a 
person supplying the data to be recorded oh the disk 
(Provider Unique ID: PVRJD). a video manager menu 
video object set start address (VNGM_VOBS_SA). the 
end address (VMGI_MAT_EA) of a volume manager 
information management table (VMGI-MAT) 78, and the 
start address (TT_SRPT^SA) of a title search pointer 
table (TT SRPT) 79. The end address of VMG.MAT 78 
(VMGI_MAT_EA) and the start address of TT.SRPT 
(TT SRPT_SA) 79 are represented by the number of 
logical blocks, relative to the first logical block. : 

Furthermore, in the table 78. the start address 
• (VTS ATRT.SA) of the attribute table (VTS_ATRT) 80 
of video title sets (VTS) 72 is represented by the 
number of bytes, relative to the first byte in the VMGl 
manager table (VMGL.MAT) 71, and the video attribute 
(VMGM V AST) of the video manager menu (VMGM) 
IsWftten. Further written in the table 78 are the number 
of audio streams (VMGM_AST_Ns) in the video man- 
ager menu (VMGM). the attributes of audio streams 
: (VMGM_AST_ATR) in the video manager menu 
':' (VMGM), the number of sub-picture streams 
(VMGM SPST_Ns) In the video manager menu 
(VMGM)l and "the attributes of sub-picture streams 
. (VMGM_SPST_ATR) in the video manager menu 

(VMGM): ! 
; In the title search pointer table (TT_SRPT) 79, as 
- shown in FIG. 9. the title search pointer table informa- 
tion (TSPTlj is first written and then as many title search 
pointers for input numbers 1 to n (n s 99) as are needed 
are written consecutively. When only the reproducing 
data for one title, for example, only the video data for 
one title, Is stored in the volume of the optical disk, only 



one title search pointer (TT_SRP) 93 is written in the 
table CTT.SRPT) 79. .' 

the title search pointer table information (TSPTI) 
'■' 92 contains the number of entry program chains 
s (EN PGC.Ns) and the end address (TT_SRPT_EA) of 
the title search pointer 93 as shown in FIG. 10. The 
address CTT_SRPT_EA) Is represented by the number 
of bytes, relative to the first byte in the title search 
pointer table (TT_SRPT) 79. Furthermore, as shown in 
io FIG. 1 1 , each title search pointer (TT_SRP) 93 contains 
the video title set number (VTSN). the program chain 
number (PGCN). and the start address (VTS.SA) of the 
video title set 72. The contents of the title search pointer 

(TT SRP) 93 specifies a video title set 72 to be repro- 
f 5 duced and a program chain (PGC) 87 as well as a loca- 
tion in which the video title set 72 is to be stored. The 
start address (VTS_SA) of the video title set 72 is repre- 
sented by the number of logical blocks in connection 

with the title set 72 specified by the video title set 
20. number (VTSN). 

The structure of the logic format of the video title set 
72 shown in FIG. 4 will be described with reference to 
FIG. 1 2. In each video title set (VTS) 72, four Herns are 
written in the order shown in FIG. 12. Each video title 
25 set (VTS) 72 is made up of one or more video titles hav- 
ing common attributes. The video title set information 

(VTSI) 94 contains the management information on the 
video titles, including the information on entry search 
points, the information on playback of video object sets 
30 72. the information on playback of title set menus 
(VTSM). and the attribute information on video object 
sets 72. 

Each video title set 72 is provided with the backup 
of the video title 6et information (VTSI.BUP) 97. 
35 Between the video title set information (VTSI) and the 
backup of the information (VTSI_BUP) 97, a video 
object set for video title set menus (VTSMJVOBS) 95 
and a video object set for video title set titles 
(VTSTT VOBS) 96 are arranged. Both of Ihe video 
40 object sets (VTSMJ/OBS and VTSTT_VOBS) 95, 96 
have the structure shown in FIG. 6. as explained earlier. 

The video title 6et Information (VTSI) 94, the 
backup of the information (VTSI.BUP) 97. and the 
video object set (VTSTT_VOBS) 96 for video title set 
45 titles are items indispensable to the video title set 72. 
The video objectset (VTSM_VOBS) 96 for video title set 

menus is an option provided es the need arises. 

The video title 6et information (VTSI) 94 consists of 
four tables as shown in FIG. 12. The four tables are 
bo forced to align with the boundaries between logical sec- 
tors. The video title set information management table 
(VTSI_MAT) 98, a first table, is a mandatory table, in 
which the size of the video title set (VTS) 72. the start 
addresses of each piece of information in the video title 
55 set (VTS) 72. and the attributes of the video object sets 
(VOBS) 96 in the video title set (VTS) 72 are written. 

The video title set direct access pointer table 
(VTS DAPT) 99, a second table, is an optional table 
provided as the need arises. Written in the table 99 are 
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the program chains (PGC) 87 and/or programs (PG) 89 
contained in the video title set 72 that are selectable 
according to the entry of a title number from the key/dis- 
play section 4 of the apparatus, j I 

The video title set program chain information table 
(VTS_PGCIT) 100, a third table, is a mandatory table, in 
whicMhe VTS program chain information (VTS_PGCI) 
104 is written. The video title set time search map table 
(VTSJMPT) 101, a fourth table, is an optional table 
provided as the need arises, in which the information on 
the recording location, for a specific period of time of 
display, of the video data in each program chain (PGC) 
87 in the title set 72 to which the i map table 
(VTSJ/IAPT) 101 belongs is written. 

Next, the video title information management table 
(VTSLMAT) 98 and video title set program chain infor- 
mation table (VTSLPGCIT) 100 Shown in FIG. 12 will 
be described with reference to FIGS. 13 to 20. j 

FIG. 13 shows the contents of the video title infor- 
mation management table (VTSLMAT) 98, in which the 
video title 6et identifier (VTSJD). the size of the video 
title set 72 (VTS_SZ), the version number of the DVD 
video specification (VERN), and the video title set cate- 
gory (VTS.CAT) are written in that order. Furthermore, 
in the table (VTSLMAT) 98. the : start address of the 
video object set (VTSM_VOBS) for VTS menus is 
expressed by a logical block relative to the first logical 
block in the video title set (VTS) 72. The start address 
(VTSTTJ/OB.SA) of the video object 83 for titles in the 
video title set 0/TS) 72 is expressed by a logical block 
(RLBN) relative to the f irst logical block in the video title 
set (VTS) 72. ' )' 

Furthermore, in the table (VTSLMAT) 98. the end 
address (VTI_M AT_EA) of the video title set information 
managemenftable (VTLM AT) 98 is represented by the 
nun*er of blocks, relative to the first byte in the table 
(VTLMAT), 98 and the start address of the video title 
set direct access pointer tabte (VTS_DAPT) 99 is repre- 
sented by the number of blocks, relative to the first byte 
in the video title set information (VTSI) 94. ; 

Still furthermore, In the table (VTSLMAT) 98, the 
start address (VTS_PGCIT_SA) of the video Me set 
program chain information table (PGCIT) 100 is 
expressed by the number of blocks, relative to the first 
byte of the video title set information (VTSI) 94, and the 
start address (VTS_MAPT_SA) of the time search map 
(VTS.MAPT) 101 In the video j title set (VTS) 72 is 
expressed by a logical sector relative to the first logical 
sector in the video title set (VTS) 72. Written in the table 
(VTSLMAT) 98 are the video object set (VTSM_VOBS) 
95 forlhe video title set menu (VTSM) in the video title 
set (VTS) 72, the video attributes (VTS_V_ATR) of the 
video object set (VTST_VOBS) 96 for the titles (VTSTT) 
in the video title set 72, and the number of audio 
streams (VTS_AST_Ns) in the video, object set 
(VTSTT_VOBS)T82 for the titles (VTSTT) for the video 
title sets 72. Here, the video attributes (VTSJV>TR) 
Include a video compression mode, a frame rate of the 



TV system, and an aspect ratio tor displaying an image 
on a display unit. 

Written in the table (VTSLMAT) 98 are the audio 
stream attributes (VTS_AST_ATR) of the video object 
5 set (VTST_VOBS) for the titles (VTSTT) in the video title 
set (VTS). The attributes (VTS_AST_ATR) include an 
audio encoding mode indicating how audio is encoded, 
the number of bits used to quantize audia and the 
number of audio channels. 
10 Furthermore, written in the table (VTSLMAT) 93 
are the nurrt>er (VTS_SPST_Ns) of sub-picture 
streams in the video object set 82 for the titles (VTSTT) 
in the video title set (VTS) 72 and the attrfcutes 
(VTS_SPST_ATR) of each sub-picture stream. The 
15 attributes (VTR^SPST.ATR) for each $ubi>icture 
stream include a sub-picture coring mode and a sl6- 
picture display type. 

Furthermore, in the table (VTSLMAT) 98, written 
are the nurtter (VTSM_AST_Ns) of audio streams in 
20 the video title set menu (VTSM). the audio stream 
attributes (VTSM_AST_ATR) 4 the inunfcer 
(VTSM_SPST_Ns) of sup-picture streams, and the sup- 
picture streamattributes (VISM.SPST.ATR). \ 

The VTS program chain information taWe 
25 (VTSLPGCIT) 1 00 has a structure as shown in FKx H. 
In the information table (VTS.PGCIT) 100. information 
on the VTS program chain (VTS _PGC) is written, start- 
ing with information (VTS.PGCITJ) 102 on the infor- 
mation table (VTS_PGCJT) 100 related to the VTS 
so program chain (VTSJ>GC). In the information table 
(VTS_PGCIT) 100. the information (VTS_PGCrrj) 102 
is followed by as many VTS.PGCI search pointer 
(\nS_PGCIT_SRP) 103 used to search for VTS pro- 
grarnchains (VTS_PGC) as the number (#1 to #n) of 
35 VTS program chains in the information table 
(VTSLPGCIT). At the end of the table, there are pro- 
vided^ many pieces of information (VTS^PGCl) 104 
on the respective VTS program chains (VTS_PGC) as 
the number (from #1 to #n) of the VTS program chains 
40 (VTS_PGC). 

The information (VTS_PGCITJ) 102 in the VTS 
program chain information table (VTS_PGCIT) 100 con- 
tains the number (VTS^PGC^Ns) of VTS program 
chains (VTS.PGC) as shown in FIG. 15. The end 
as address (VTS.PGCIT^EA) of the table information 
(VTS_PGCIT_i) 102 is expressed by the number of 
bytes, relative to the first byte in the information table 
(VTSLPGCIT) 100. 

Furthermore, as shown in FIG. 1 6. the VTS .PGCIT 
$o search pointer (VTS_PGCIT_SRP) 103 contains the 
attributes (VTS_PGcLCAT) of the program chains 
(VTS_PGC) in the video title set (VTS) 72 and the start 
address (VTS_PGCI_SA) of the VTS.PGC information 
(VTS_PGCI) 104 expressed by the number of bytes, rd- 
55 ativelo the first byte in the VTS.PGC information table 
(VTS_PGC1T) 100. Here, the VTS^PGC ; attribute 
(VTS_PGC_CAT) is. tor example, an attribute indicating 
whether an entry program chain (Entry PGC) is the f irst 
one to be reproduced. Usually, an entry program chain 
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(PGC) is written before program chains (PQC) that are 
not entry program chains (PGC). Generally, program 
chains (PGC) are reproduced in the description order of 
VTS_PGCIs as shown in FIG. 14. 
; The PGC information (VTS_PGCI) 104 in the video 
titte set, 72 contains four items as shown in FIG, 17. In 
the PGC information (VTS^PGCI) 104, the program 
chain general information (PGC_GI) 105 on a manda- 
tory item is first arranged, followed by at least three 
items that are made mandatory only when there is an 
video object; 83. Specifically, contained as the three 
items in the PGC information (VTS_PGC1) 104 are a 
program chain program map (PGC_PGMAP) 1 06, a cell 
playback Information table (CPBJT) 107, and a cell 
position information table (C_POSiT) 108. 
. \ As shown in FIG. 18, the program chain general 
information (PGCJ3I) ^105 contains the category 
(PGCL0AT): of the program chain 87. the contents 
(PGC_CNT) of the program chain (PGC) 87, and the 
playback time of the program chain (PGC). 87 Written in 
the category of PGC (PQCLCAT) are whether the PGC 
can be copied or not and whether the programs 89 in 
the PGC are played back continuously or at random. 
The contents of PGC (PGC_CNT) contains the descrip- 
tion of the program chain structure, that is, the number 
of programs 89, the number of ceils 84, and the number 
of angles in the program chain 87. The playback time of 
PGC (PGC_PB_TIME) contains the total playback time 
of the programs® in the PGC. The playback time is the ; 
time required to continuously play back the programs 89 
in the PGC, regardless of the playback procedure. 
' 'i Furthermore, the program chain general informa- 
tion (PGC_GI) 1 05 contains PGC 6ub-picture stream 
control (PGC_SPST_CTL), PGC audio stream control 
(PGOSTJSTL), and PGC sub-picture ; pallet 
(PGCISP_PLT). The PGC sub-picture stream control 
(PGC SPST_CTL) contains the number of sub-pictures 
usable in the PGC 89 and the PGC audio stream control 
(PGC AST_CTL) likewise contains the number of audio , 
streams' usable in the PGC 89. The PGC sub-picture 
palette (PGC_SPJ 3 LT); contains a set of a specific 
number of coior pallets 'used In all of the sub-picture 
streams in the PGC 89. ; 

i Furthermore, the PGC general information 
(PGCJ3I) 105 contains the start address <C_PBIT_SA) 
of thecell playback information table (C_PBIT) and the 
start address (C_POSIT_SA) of the cell position infor- 
mation : ; table (C_POSff) 108. Both of the start 
addresses (CJ>BIT_SA and C_POSIT_SA) are repre- 
sented by the number of logical blocks, relative to the 
first byte in the VTS_PGC information (VTS.PGCl) 1 05. 

• The program chain program map (PGC_PGMAP) 
1 08 is a'map showing the arrangement of the programs 
89 in the PGC 87 of FIG.19. In the map (PGC_PGMAP) 
106, the entry cell numbers (ECELLN). the start cell 
numbers of the individual programs 89, are written in 
ascending order as shown in FIGS. 19 and 20. In addi- 
tion, program numbers are allocated, starting at 1 , in the 
order in which the entry cell numbers are written. Con- 



sequently, the first entry number in the map 
(PGC_PGMAP) 106 must be #1. 

The cell playback information table (C.PBIT) 
defines the order in which the cells 84 in the PGC 87 are 

5 played back. In the cell playback information table 
(C_PBIT) 107, pieces of the cell playback information 
(C~PBI) are written consecutively as shown in FIG, 21 . 
Basically, cells 84 are played back in the order of cell 
number. The cell playback information (C_PBI7) 108 

10 contains a cell category (C_CA7) as shown in FIG. 22. 
Written in the cell category (C_CAT) are a cell block 
mode indicating whether a cell is in the block and if it is 
in the block, whether the cell Is the first one, a cell block 
type indicating whether a cell 84 is not part of the block 

75 or is in an angle block, and an STC discontinuity flag 
indicating whether the system time clock (STC) must be 
set again. 

Further written in the cell category (C JJAT) are a 
cell playback mode indicating whether the video object 

20 units (VOBU) 85 in the cell 84 are played back continu- 
ously or a picture is made 6till at one video object unit 
(VOBU) 85 to another in the cell 84, and cell navigation 
control incficating whether the picture is made still after 
the playback of the ceil or indicating the rest time. 

25 As shown in FIG. 22, the cell playback information 
table (C.PBIT) 107 contains the cell playback time 
• (C.PBTNM) representing the total playback time of the 
PGC 87. When the PGC 87 has an angle ceil block, the 
playback time of the angle cell number 1 represents the 

so playback time of the angle block. Further written in the 
cell playback information, table (C.PBIT) 107 are the 
start address (CJ^OBU.SA) of the first video object 
unit (VOBS) 85 in the cell 84 expressed by the number 
. of logical sectors, relative to the first logical sector in the 

35 video object unit (VOBS) 85 in which the cell 84 ts writ- 
ten and the start address (C_LVOBU_SA) of the end 
video object unit (VOBS) 85 in the cell 84 expressed by 
the number of logical sectors, relative to the first logical 
sector in the video object unit (VOBS) 85 in which the 

40 cell 84 is written. 

Tlie cell position information table (C.POSI) 108 
specifies the Identification number (VOBJD) of the 
video object (VOB) 85 In the cell used in the PGC 87 
and the identification number (Cell _ID) of the cell 84. In 

45 the cell position information table (C_POSI) 1 08, pieces 
of the cell position information (CPOSI) corresponding 
to the cell numbers written in the cell playback informa- 
tion table 107 as shown in FIG. 23 are written in the 
. same order as in the cell playback information table 

so (C_PBIT) 107. The cell position information (C_POSI) 
contains the identification number (C.VOBJDN) of the 
video object unit (VOBS) 85 in the cell 84 and the cell 
identification number (CJDN) as shown in FIG. 24. 
As explained with reference to FIG. 6. a cell 84 is a 

55 set of video object units (VOBU) 85. A video object unit 
85 is defined as a pack train starting with a navigation 
(NAV) pack 86. Therefore, the start address 
(C_FVOBU_SA) of the first video object unit (VOBU) 85 
in a cell 84 is the start address of the NAV pack 86. As 
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shown in FIG. 25, the NAV pack 86 consists of a pack 
header 1 1 0. a system header 1 1 1 . and two packets 116, 
117 of navigation data; namely, a presentation control 
information (PCI) packet 116 and a data search infor- 
mation (DSI) packet 117. As many bytes as shown in 
FIG. 25 are allocated to the respective sections so that 
one pack may contain 2048 byte£ corresponding to one 
logical sector. The NV pack is 'provided immediately 
before the video pack 88 which contains the first data 
item In the group of pictures (GOP). Even if the object 
unit 85 contains no video pack 88, the NV pack 86 is 
positioned at the head of the object unit 85. provided 
that the object unit 85 contains an audio pack 91 and/or 
a sub-picture pack 90. Thus, even H object unit 85 con- 
tains no video pack, its playback time is determined on 
the basis of the time required for playing back a video 
pack 88, exactly in the 6ame way as in the case where 
the unit 85 contains a video pack 88. 

Here, GOP is defined as a data train constituting a 
screen determined in the MPEG standards. In other 
words, GOP is equivalent to compressed data which 
may be expanded into image data representing a plural- 
ity of frames of a moving picture; The pack header 110 
contains a pack starting code, a system dock reference 
(SCR), and a multiplex rate. The system header 111 
contains a bit rate and a stream ID. The packet header 
1 1 2. 1 1 4 of each of the PCI packet 1 1 6 and DCI packet 
117 contains a packet starting code, a packet length, 
and a stream ID as determined in the MPEG2. . 

As shown in FIG. 26, another video park 88. audio 
park 91 or sub-picture pack 90 consists of a pack 
header 120. packet header 121 , and a packet 122 con- 
taining the corresponding data as in the system layer 24 
MPEG 2. Its pack length is determined to be 2048 
bytes. Each of these packs is aligned with the bounda- 
ries between logical blocks. | 

It is to be noted that PTS (Presentation Time 
Stamp; time management information for the repro- 
duced output) and DTS (Decoding Time Stamp; decod- 
ing time management information) are additionally 
stored In the packet header 12i of the video pack 88 
which includes head data of the j picture of GOP. PJS is 
additionally stored in the packet header 121 of the audio 
pack 91 . PTS is additionally stored in the packet header 
121 of the sub-picture pack 90 which indudes the head 
data of a sub-picture unit consisting of a plurality of sub- 
picture packs 90 for one still picture to be reproduced at 
the 6ame time. j •;.'!■ 

SCR to be stored in each pack increases in the 
recording order on the optical disk 10 with the value of 
the head pack of (video) data for each video object 
taken as 0. | 

The PCI data (PCI) 113 in the PCI packet 116 is 
navigation data used to make a presentation, or to 
change the contents of the display, in synchronization 
with the playback of the video data in the VOB unit 
(VOBU) 85. Specifically, the PCI data (PCI) 113 con- 
tains PCI general information (PCLGI) as information 
on the entire PCI data 1 1 3 change as shown in FIG. 27. 



The PCI genera! information (PCLGI) contains the 
address (NVPCK_LBN) of the NV pack (NV_PCK) 86 
in which the PCI data is recorded as shown in FIG. 28, 
the address being expressed in the number of blocks, 
s relative to the VOBU logical sector in which the PCI data 
is recorded. The PCI general information (PCLGI) con- 
. tains the category of VOBU (VOBU.CAT). the start PTS 
of VOBU 85 (VOBU_SPTS). and the end PTS of VOBU 
85 (VOBU_EPTS).~Here. the start PTS of VOBU 85 
10 (VOBUSPTS) indicates the playback start time (start 
presentation time stamp (SPTS)) of the video data in 
the VOBU 85 containing the PCI data. The playback 
start time is the playback start time of the first picture in 
the f irst GOP kx the VOBU 85. Normally, the first picture 
J5 corresponds to I picture (intra-picture) data in the MP EG 
standards. The end PTS (VOBU_EPTS) in the VOBU 
85 indicates the playback end time (end presentation 
time stamp (EPTS)) of the video data in the VOBU 85 
containing the PCI data. The playback end time ts the 
zo playback start time of the last picture in the last GOP in 
the VOBU 85. 

Tho DSI data (DSI) 115 in the DSI packet 117 
shown in FIG. 25 is the navigation data used to search 
for a VOB unit (VOBU) 8S. The DSI data (DSI) 115 con* 
25 tains the DSI general information (DSI_GI). VOBU 
search information (VOBU_Sl). and the synchronizing 
playback information (SYNCl) as shown in FIG. 29. 

The DSI information (DSLGI) contains information 
about the entire DSI data 1 1 5. Specifically, as shown in 
$o FIG. 30, the DSI general information (DSLGI) contains 
the system clock reference for the NV pack 
(NV_PCK_SCR) 86. The system dock reference 
(NV_PCK_SCR) is stored in the system time dock 
(STC) 54 a| 58 A, 60 A or 62A built in each section of FIG. 
35 1 . On the basis of the STC 54 A, 58A. 60A, 62A, video, 
audio, and sub-picture packs are decoded at the video, 
audio, and sub-picture decoders 58, 60, and 62 and the 
monitor 6 and the speaker 8 reproduce images and 
sound, respectively. The DSI general information 
40 (DSLGI) contains the start address (NV_PCK_LBN) of 
the NV pack (NV_PCK) 86 containing the DSI data 
expressed by the number of logical sectors (RLSN)* rel- 
ative to the first logical sector in the VOB set (VOBS) 82 
containing the DSI, and the address (VOBU.EA) of the 
45 last pack in the VOB urit (VOBU) 85 containing the DSI 
data expressed by the number of logical sedots 
(RLSN), relative to the first logical sector in the VOB unit 
(VOBU) 85. 

Furtha-more, the DSI general information (DSLGI) 
so contains the end address (VOBUJP.EA) of the V pack 
(V_PCK) 88 containing the last data item for the first I 
picture in the VOB unit (VOBU) expressed by the 
number of logical sectors (RLSN), relative to the first 
logical sector in the VOB unit (VOBU) 85 containing the 
55 DSI data, and the identification number (VOBUJP^EA) 
of the VOB 83 containing the DSI and the identif ication 
nurcfcer (VOBU_CJDN) of the cell 84 in which the DSI 
data is recorded. 
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': The. search information (VOBU_SI) in VOBU 85 
• contains information used to identify the first address in 
a cell 84.. ' I * 

;j The -synchronizing information (SYNCI) contains 
address information on the sub-pictures and audio data 
reproduced in synchronization with the playback start 
time of the video data in the VOB unit (VOBU) 85 con- 
taining the DSI data. Specifically, as shown in FIG. 31, 
the start; address (A_SYNCA) of the target audio pack 
: (A PCK) is expressed by the number of logical sectors 
(RLSN), relative to the NV pack (NV_PCK) 86 in which 
DSI data 115 is recorded. When there are more than 
one audio stream (8 audio streams maximum), as many 
pieces of the synchronizing information (SYNCI) as 
. there are audio streams are written. Furthermore, the 
synchronizing information (SYNCI) contains the 
■;' address (SP_SYNCA) of the NV pack (NV.PCK) 86 of 
the VOB unit (VOBU) 85 containing the target audio 
pack (SP_PCK) 91 , the address being expressed by the 
number !of logical sectors (RLSN), relative to the NV 
pack (NVJ>CK) 86 in which DS1 1 15 is recorded. When 
there are more than onefcub-picture stream (32 sub-pic- 
ture streams maximum), as many pieces of the syn- 
chronizing information (SYNCI) as there are sub-picture 
streams are written. •[,:'•• 

■f Referring to FIO. 32, a sub-picture unit constituted 
of sub-picture data of a' plurality of sub-picture packets 
will now; be describe. A sub-picture unit as several doz- 
ens of, still picture data (e.g., superimposition) can be 
recorded in one GOP. The sub-picture unit consists of a 
sub-picture unit header (SPUH), pixel data (PXD) com- 
prised of run-length data, and a display control 
sequence table (DCSQT). . 
■ Described in the sUb-picture unit header (SPUH) 
- are the size (SPDSZ) of the sub-picture unit and the 
start address (SPDCSQTA) of the display control 
sequence table, as shown in FIG. 33. 

■;. Display control sequences (DCSQ) are described 
i In a chronological order in the display control sequence 
table (DCSQT) as shown in FIG. 34. 

The start address (SPNDCSQA) and display con> 
trol command (SPDCCMD) of the next display control 
sequence are described in each display, control 
sequence (DCSQ) as shown in FIG. 35. 
? The display control command (SPDCCMD) con- 
; slsts of a command (F3TA_DSP) for setting the timing 
for starting the forced-display of pixel data, a command 
(STA DSP) for setting the display 6tart timing for pixel 
datafa command (STPiDSP) for setting the display end 
timing for pixel data, a command (SET_COLOR) for set- 
ting a color code of pixel data, a command 
(SETJ30NTR) for setting the contrast between pixel 
data and main picture,^ command (SETJDAREA) for 
setting 1 ; the display area for pixel data, a command 
(SET_DSPXA) for setting the display start address for 
; pixel data, a command (CHG_COLCON) for setting a 
: color change and contrast change in pixel data, and a 
;■' command (CMD_END) for terminating the display con- 
trol command. , . . i 



The command (STAJDSP) designates the display 
; start time for sub-picture data, and is described by an 
offset PTS from PTS described in a sub-picture packet 
which includes a sub-picture unit header (start PTS). 
5 . The command (STP_DSP) designates the display stop 
time for sito-picture data, and is described by the offset 
PTS from PTS described in a sub-picture packet which 
includes a sub-picture unit header (stop PTS). 

The start PTS and stop PTS are delayed by arbi- , 
io trary predetermined times from those of main picture 
data and audio data which are reproduced in the same 
timeslot 

The system processor section 54 shown In FIG. 1 
has a packet discrimination/transfer section 54b, which 
15 compares the time in an internal STC timer 54a with the 
SCR (System Clock Reference) described in the pack 
header of each pack to discriminate the packet type of a 
matching pack, and sends the data of that packet to 
individual associated sections. The packet data of a 
20 navigation pack, which has been discriminated by this 
packet discrimination/transfer section 54b, is transferred 
to the data RAM section 56, the packet data of a video 
pack, discriminated by the section 54b, is transferred 
together with an input clock to the video buffer section 
25 59, the packet data of an audio pack, discriminated by 
the section 54b, is transferred together with an input 
clock to the audio buffer section 61 , and the packet data 
of a sub-picture pack, discriminated by the section 54b, 
is transferred together with an input clock to the sub-pic- 
30 ture buffer section 63. 

As shown in FIGS. 36A to 36F, for example, when 
data is output packet by packet, the input clock is output 
to the buffer associated with that packet type. 

Accordingly, the system processor section 54 
35 sequentially outputs sequences of video data, audio 
data and sub-picture data, which are to be reproduced 
in the same time slot, together with the input clock to the 
associated buffers. 

The system processor section 54 sends the PTS 
40 (Presentation Time Stamp) and DTS (Decoding Time 
Stamp), described in the packet header of a video data 
pack, the PTS, described in the packet header of an 
audio data pack, the start PTS and stop PTS, which are . 
specified by the display control command (DCSQ) and 
45 are included in the PTS, described in the packet header 
of a 6ub-picture data pack, and the time in the internal 
STC timer 54a or the SCR to the buffer controVSTC 
control section 57, 

The buffer control/STC control section 57 is 
so designed to store the SCR from the system processor 
section 54 into an STC timer 57a, outputs the SCR and 
the PTS and DTS of each data to the associated decod- 
ers, and outputs an output clock to the buffers associ- 
ated with the PTS and DTS/ 
55 For example, one unit of output clocks as shown in 

FIG. 36H is output to the video buffer section 59 in 
accordance with the DTS for video data as shown in 
FIG. 36G, one unit of output clocks as shown in FIG. 
36J is output to the audio buffer section 61 in accord- 



25 I EP07302 

ance with the PTS for audio data as shown in FIG. 361. ■ 
and one unit of output clocks as shown in FIG. 36L is 
output to the sub-picture buffer section 63 in accord- 
ance with the start PTS for sub-picture data as shown in 
FIG. 36K. | 5 

Each of the video buffer section 59, audio buffer ; 
section 61 and sub-picture buffer section 63 shown in 
FIG. t is an FIFO (First In First Out) memory which is a 
ring buffer comprised of FF circuits, as shown in FIG. 

37. If the capacity of this FIFO memory is set to approx- to 
■ imately 10 times the VOBU (Video Object) recorded on 

the optical disk 10. data for several seconds to ten sec- 
onds can be retained. The FIFO memory stores data, 
supplied from the system processor section 54, In 
accordance with input data that is simultaneously sup- ts 
plied, and outputs the stored data in response to the ; 
output clock supplied from the buffer control/STC con- : 
trol section 57. j 

The video decoder section 58 shown in FIG. 1 com- 
prises an STC timer 58a, registers' 58b and 58c, compa- so 
rators 58d and 58e, and a deccder 58f, as shown in FIG. 

38. The SCR set by the buffer control/STC control sec- 
tion 57 is stored in the STC timer 58a and the time 
therein is updated by a clock. The register 58b retains 
the DTS for video data which is set by the buffer con- 25 
trol/STC control section 57. The register 58c retains the . 
PTS for video data which is set by the buffer con- 
trol/STC control section 57. The comparator 58d com- 
pares the STC in the STC timer 58a with the DTS in the 
register 58b to check if they match with each other. The so 
comparator 58e compares the STC in the STC timer 
58a with the PTS in the register 58c to check if they 
match with each other. The decoder 58f decodes the 
video data input from the video buffer section 59 in 
accordance with the output of the comparator 58d and 35 
outputs the decoding result to the mixing section 64 in 
accordance with the output of the comparator 58d. 

The audio decoder section 60 shown in FIG. 1 com- 
prises an STC timer 60a, a register 60b, a comparator 
60c, and a decoder 60d. as 6hown in FIG. 39. The SCR *o 
set by the buffer control/STC control section 57 is stored 
in the STC timer 60a and the time therein is updated by 
a clock. The register 60a retains the PTS for audio data 
which is set by the buffer control/STC control section 57. 
The comparator 60c compares the STC in the STC 45 
timer 60a with the PTS in the register 60b to check H 
they match with each other. The decoder 60d decodes 
the audio data input from the audio buffer section 61 in 
accordance with the output of the comparator 58d when 
a match is made, and outputs the decoding result to the so 
audio D/A section 68. I 

The sub-picture decoder section 62 shown in FIG. 1 
comprises an STC timer 58a. registers 62b and 62c. • 
comparators 62d and 62e, and a decoder 62f. as shown 
in FIG. 40. The SCR set by the buffer control/STC con- 55 
trol section 57 is stored in the STC timer 62a and the 
time therein is updated by a clock. The register 62b 
retains the start PTS for sub-picture data which is set by 
the buffer control/STC control section 57. TTie register 



T2A2 26 

62c retains the stop PTS for sub-picture data wKch is 
set by the buffer control/STC control section 57. The 
comparator 62d compares the STC in the STC timer 
62a with the start PTS in the register 62b to check if they 
match with each other. The comparator 62e compares 
the STC in the STC timer 62a with the step PTS in the 
register 62c to check if they match with each other. The 
decoder 62f starts decocfing the sti>-picture data input 
from the sub-picture buffer section 63 in accordance 
with the output of the comparator 62d when there is a 
match, and outputs the decoding result to the mixing 
section 64 in accordance with the output of the compa- 
rator 62d when there is a match. 

Referring again to FIG. 1. a description will now be 
given of the operation of reproducing movie data on 
English conversations for learning English, from the 
optical disk 10 which has the logical format shown in 
FIGS, 4 to 31. 

When the optica! disk apparatus shown in FIG. 1 is 
powered on and the optical disk 10 where movie data 
tor English conversations for . learning English is 
recorded rs loaded, the system CPU section 50 reads 
the initialization program from the system ROM and 
RAM section 52, and activates the dskdrrve section 30. 
Therefore, the disk drive section 30 starts reading the 
lead-in area 27 and reads the volume and file structure 
area 70, which follows the lead-in area 27 and defines 
the volume and file structure in conform to 1SO-9660 or 
the like. More specifically, to read the volume and file 
structure area 70 recorded at a predetermined position 
on the disk 10 set in the cfisk drive section 30. the sys- 
tem CPU section 50 sends a read command to the disk 
drive section 30 to read the contents of the volume and 
file structure area 70 and temporarily stores the con- 
tents in the data RAM section 56 via the system proces- 
sor section 54. The system CPU section 50 extracts 
information on the recorded position, recording capac- 
ity, size or the like of each file and other necessary man- 
agement information via the pass table and directory 
record stored in the data RAM section 56. transfers the 
extracted information at predetermined positions in the 
system ROM and RAM section 52 and saves the infor- 
mation there. 

Next, the system CPU section 50 refers to informa- 
tion on the recorded position and recording capacity of 
each file from the system ROM and RAM section 52 to 
acquire a video manager 71 , which consists of a plural- 
ity of f Jes starting with a file number 0. That is, referring 
to the information on the recorded position and record- 
ing capacity of each file acqured from the system ROM 
and RAM section 52. the system CPU section 50 sends 
a read command to the cfisk drive section 30 to obtain 
the positions and sizes of a plurality of f 2es which con- 
stitute the video manager 71 existing on the root tf rec- 
tory, reads this video manager 71 and stores the 
acqured information into the data RAM section 56 via 
the system processor section 54. A volume manager 
information management table (VMGLMAT) 78. which 
is the first table in this video manager 71. is searched. 



27 



EP 0 730 272 A2 



28 



Through;- this search, the start address 
(VMGMJ/OBS_SA) of a .video object set 
(VMGM - VOBS)"76 tor a video manager menu (VMGM) 
is acquired and the video object set (VMGM_VOBS) 76 
is reproduced. As the procedures for reproducing this 
video object set (VMGM^VOBS) 76 for the video man- 
ager menu are the same as those for the video object 
set (VTSM_VOBS) for a title in the video title set (VTS), 
their description will not be repeated. When a language 
Is set in the video object set (VMGMJ/OBS) 76 or when 
there is no video manager menu (VMGM), the volume 
manager information management table (VMGLMAT) 
78 ; is searched to : acquire the start address 



of a 



title search pointer table 



(TT_SRPT_SA) 
(TT_SRPT) 79. 

V Through tfiis search! the title search pointer table 
(rf_SRPT) 79 is transferred to a predetermined posi- 
tion in the system ROM and RAM section 52 to be 
saved there. Next, the system CPU section 50 acquires 
the end address of the title search pointer table 
(TTJSRPT) 79 from title search pointer table informa- 
tion (TSPTl) 92 and acquires the video title set number 
(VJSN). program chain number (PGCN) and the start 
address (VTS_SA) of the video title set, which are asso- 
ciated with a number entered from the key/display sec- 
tion 4, from a title i search pointer (TT_SRP) 93 
according to that input number. When there is only one 
title set one title search pointer (TT.SRP) 93 is 
searched to acquire the start address (VTS_SA) of that 
title set, irrespective of whether or not there is an input 
number [from the key/display section 4. The system 
CPU section 50 acquires the target title set from the 
start address (VTS^SA) of this title set 

: 5 The system CPU section 50 acquires the number of 
streams of the video, audio and sub-picture data for the 
volume menu and their attrtoute information, described 
in the volume manager information management table 
(VMG1 MAT) 78 in a volume manager (VMGI) 75, and 
sets parameters for reproducing the video manager 
menu in the associated video decoder section 58, audio 
decoder section 60 and sub-picture decoder section 62 
based on the attribute Information. 

■i Next, as shown in FIG. 12, video title set informa- 
tion (VTSI) 94 of the title set is acquired from the start 
address (VTS.SA) of a video title set 72. From a video 
title set information management table (VTSLMAT) 98 
in this video title set information (VTSI) 94, the end 
address(VTI MAT EA) of the video title set information • 
managemenftable (VTSLMAT) 98 shown in FIG. 13 is 
acquired. Based on' the number of streams 
(VTS_AST^Ns, VTS_SPST_Ns) of audio data and sub- 
picture data and the attribute information (VTS _VATR, 
VTS.A^ATR, VTS_SPST_ATR) of the video, audio and 
sub-picture data, the individual sections of the repro- 
ducing apparatus shown in FIG. 1 are set according to 
their attributes. j 

. i Cell playback information (C_PBl) shown in FIG. 21 
is acquired from a start address (C_POSIT_SA), and 
the start address (C_FVOBU_SA) of the first VOBU 85 



and the start address (CiLVOBU_SA) of the last VOBU 
in the cell shown in FIG. 22, which are described in the 
playback information (C_PBI), are acquired to search 
for the target cell. The cell playback order is determined 
5 in such a way that playback cells 84 are determined one 
by one by referring to the program map shown in FIG. 
19 in a PGC program map (PGC_PGMAP) 106 shown 
in FIG. 17. The data cells 84 of the program chain, 
determined in this manner, are sequentially read from a 
io video object 1 44 and are Input to the data RAM section 
56 via the system processor section 54. The system 
processor section 54 sends each data cell 84 via the 
individual buffer sections 59, 61 and 63 to the video 
decoder section 58, audio decoder section 60 and sub- 
15 picture decoder section 62 to be decoded based on the 
DTS as decode time information and the PTS as play- 
■'. back time information. The video data and sub-picture 
data are mixed in the mixing section 64, after which the 
resultant data Is converted to a video signal by the video 

20 D/A section 66 to reproduce an image on the monitor 
section 6. The audio data is converted to an audio sig- 
nal by the audio D/A section 68 which is sent to the 
speaker section 8 for sound reproduction. 

At this time, the superimposifion as sub-picture, 
25 data is mixed with main picture data to be displayed 
when a predetermined time elapses after the display of 
the main picture data. 

The reproduction of video data will be described 
more specifically, with reference to the flowchart illus- 
30 tratedinFIG.41. > 

In the reproduction of video data, when playback 
starts at step S1 1 as shown in FIG. 41 , the system CPU 
section 50 searches the volume manager (VMGI) 75 
and stores it in the system ROM and RAM section 52 in 
35 step S12 as has already been discussed above. Uke- 
wise, the video title set information (VTSI) 94 o! the 
video title set (VTS) 72 is read based on this volume 
manager (VMGI) 75, and the video title set menu is dis- 
. played on the monitor section 6 using its video object 
40 set (VTSM VOBS) 95. Based on this display, the title 
set 72 to be reproduced and the playback conditions or 
the like are determined by a user as indicated in step 
: S13. When the determined title set 72 is selected using 
the key/display section 4, the system CPU section 50 
45 reads data of a cell playback information table (C_PBIT) 
107, shown in FIGS. 17, 21 and 22, from a program 
chain information (VTS_PGCIT) 100 shown in FIG. 12 
in the selected title set 72 and stores the data in the sys- 
tem ROM and RAM section 52 as indicated in step S1 4. 
In accordance with the playback conditions entered 



so 



from the key/display section 4, the system CPU section 
: 50 determines the program chain number 
(VTS_PGC_Ns) for starting playback, the audio stream 
nunfcer andsub-picture stream number, as indicated in 
55 step S15. For example, lessen 1 of the English conver- 
sation for learning English is selected as a title, and dis- 
playing superimposition as a sub-picture is determined. 
The determined sub-picture number and audio stream 
nuntoer are set in the register (not shown) in the system 
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processor section 54 as indicated n step S1 6. Likewise, 
the playback start time is set in the system clock (STC) 
timers 54a, 57a, 58a. 60a and 62a in the system proc- 
essor section 54. buffer control/STC control section 57. 
video decoder section 58 and audio decoder section 60 s 
and sub-picture decoder section 62. Further, the start 
address of the first VOBU in a cell as the start address 
and the PGC number or cell number are stored in the 
system ROM and RAM section 52. * 

As indicated in step SI 7. the system CPU section io 
50 sends a read command to the : disk drive section 30 
when it is ready to read the video title set, and the disk 
drive section 30 seeks the optical disk 10 based on the 
aforementioned start address. In response to the read 
command, cells associated with the specified program is 
chain (PGC) are sequentially read from the optical disk 
1 0. and are sent to the data RAM section 56 via the sys- 
tem CPU section 50 and system processor section 54. 
The transferred cell data is stored in the data RAM sec- 
tion 56 pack by pack, 1 starting from navigation pack 86 so 
as the head pack of the video object unit (VOBU) 85 as 
shown in FIG. 6. Thereafter, the system processor sec- 
tion 54 and buffer control/STC control section 57 distrib- 
ute the video data of the video pack 88 of the video 
object unit (VOBU) to the video decoder section 58 via ss 
the video buffer section 59. distribute the audio data of 
the audio pack 91 to the audio decoder section 60 via 
the audio buffer section 61, and distribute the sub-pic- 
ture data of the sub-picture pack; 90 to the sub-picture 
decoder section 62 via the sub-picture buffer section 63. so 
The video data decoded by the video decoder section 
58 and the sub-picture data decoded by the sub-picture 
decoder section 62 are mixed by the mixing section 64, 
and the mixed data is sent to the video D/A section 66. 
The audio data decoded by the audio decoder section 35 
60 Is sent to the audio D/A section 68. Consequently, a 
video signal is sent to the monitor section 6 and an 
audio signal is sent to the speaker section 8, so that the 
video display and audio playback; will start After a pre- 
determined period of time, the sub-picture Is superim- 
posed on the display, j j I 

When the playback is complete in step S18, or 
when the end PTS (VOBU_EPTS) described in general 
information (PCI_GI) of the PCI 113 is referred to and 
this end PTS (VOBU_EPTS) matches with the system 
time clock (STC) as indicated in step S18, the screen 
display on the monitor section 6 is stopped as indicated 
in step S19. Then, the system CPU section 50 sends a 
data transfer stop command to the disk drive section 30 . 
to stop data transfer, terminating the playback operation so 
as indicated in step S20. j 

This playback process will be described more spe- 
cifically with reference to the timing chart shown in 
FIGS. 36A through 36H and the flowchart illustrated in 
FIG. 42. ■ j' ' j « 

As indicated in step S31 , the system processor sec- 
tion 54 sequentially reads the pack data, which is to be 
reproduced in the same time slot as the playback time 
set in the STC timer 54a. from th6 data RAM section 56 
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by referring to the SCR given to the pack header, deter- 
mines the packet type described in the packet header in 
that pack, and sends the packet data determined as the 
main picture to the video buffer section 59 as video 
data, the packet data determined as the audio data to 
the audio buffer section 61 as audio data, and the 
packet data determined as the sub-picture to the sub- 
picture buffer section 63 as subpicture data in accord- 
ance with the determined packet type. 

As depicted in step S32, the system processor sec- 
tion 54 sends the time set in the STC timer 54a (SCR as 
the playback time), the DTS and PTS. descrfced in the 
packet header of the head pack of the video data, the 
PTS, described in the packet header of the head pack of 
the audio data, and the start PTS and stop PTS, which 
are specified by the display control command (DCSO) 
and are included in the PTS, descrtoed in the packet 
header of the head pack of the sub-picture data, to the 
buffer control/STC control section 57. 

The buffer control/STC control section 57 sets the 
supplied SCR as the playback time in the STC timer 58a 
of the video decoder section 58. the STC timer 6Ca of 
the audio decoder section 60 and STC timer 62a of the 
sub-picture decoder section 62 as specified in step S33. 

Further, the buffer controt/STC control sect'on 57 
outputs the input clock to the video buffer section 59 
when packet data of the video data is sent to th* video 
buffer section 59 from the system processor section 54. 
outputs the input dock to the audio buffer section 61 
when the packet data of the audio data is sent fc the 
audio buffer section 61 from the system processor sec- 
tion 54, and outputs the input dock to the sithpicture 
buffer section 63 when the packet data cf the sub-pic- 
ture data is sent to the sub-picture buffer section 63 
frcm the system processor section 54. 

As a result, the video buffer section 59. audio buff er 
section 61 and sub-picture buffer section 63 store the 
supplied data in response to the input dock as 
described in step S34. 

When the STC in the STC timer 57a matches with 
the DTS of the video data, the buffer control/STC corttrd 
section 57 outputs one unit of output docks to the vsieo 
buffer section 59. When the STC in the STC tinu 
in the video decoder section 58 matches with the D ?0 r 1 
the register 58b, the decoder 58f starts decoding based 
on the output of the comparator 58d. 

Consequently, the video data output from the video 
buffer section 59 in accordance with the output dock is 
decoded by the decoder 58f as indicated in step S35. 

As is apparent from step S36, when the STC in the 
STC timer 58a in the video decoder section 53 matches 
with the PTS in the register 58c, the decoded output of 
the decoder 58! is sent to the video D/A section 66 via 
the mixing sedion 64 based on the output from the com- 
parator 58e. 

When the STC in the STC timer 57a matches with 
the PTS in the audio data, the buffer controt/STC contrd 
section 57 outputs one unit of output docks to the audb 
buffer sedion 61. When the STC in the STC timer 60a 
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in the audio decoder section 60 matches with the PTS in 
the register 60b, the decoder 60d also starts decoding 
based on the output of the comparator 60c. . 
. i Consequently, as depicted in step S37, the audio : 
data output from the audio buffer section 61 in accord- . 5 
ance with the output clock is decoded by the decoder 
60d and the decoded output is then sent to the audio 
D/A section 68: 

After a predetermined time has passed, i.e., when 
the STCin the STC timer 57a matches with the start 10 
PTS of tHe sub-picture data, the buffer control/STC con- : ; 
trol section 57 outputs one unit of output clocks to the 
sub-picture buffer section 63. When the STC In the STC 
timer 62a In the sub : plcture decoder section 62 
matches with the start PTS in the register 62b, the is 
decoder 62f starts decoding based on the output of the 
comparator 62d. : i 

Consequently, as specified in step S38, the sub- 
picture data output from the sub-picture buffer section 
63 in accordance with the output clock is decoded by .20 
the decoder 62f and thedecoded output is then mixed 
with the video data in the mixing section 64. The result- 
ant data is then 6ent to the video D/A section 66. 

i When the STC in the STC timer 62a in the sub-pic- 
ture decoder section 62 "matches with the stop PTS in 25 
the register 62c, the decoder 62f stops decoding based [ 
on the output of the comparator 62e. 

Accordingly, as indicated in step S39, the decoder. 
62f in the sub-picture decoder section 62 stops output- 
ting the decoded data. ,. 30 

I Consequently, the limage corresponding to the 
video data is displayed oh the monitor section 6 and the 
voice corresponding to ;the audio data is reproduced 
from the speaker section 8. After a predetermined time 
delay, the mixed image corresponding to the sub-picture 35 
data and video data is displayed on the monitor section 
6. Thereafter, the sub-jpwcture data will disappear. 

i At the first timing, therefore, the image of a teacher : 
pronouncing "ONE* is displayed as the main picture on* 
the monitor section 6 and the teacher's voice "ONE" is 40 
reproduced from the speaker section 8, as 6hown In 
FIG. 43A. At the next timing, as shown in FIG. 43B, the 
image of the teacher saying "ONE" is displayed as the 
main picture on the monitor section 6 and the superim- 
position "ONE" as the 6ub-picture is superimposed on 45 
the main picture. At this timing, an apprentice as a lis- 
tener 6hbuld pronounce the word. At the next timing, as 
shown in FIG. 43C. the image of the teacher saying 
"GOOD*' is displayed as the main picture on the monitor 
section 6 and the teacher's voice "GOOD* is repro- so 
duced from the speaker section 8. 

i As a result, the sub-picture which is to be displayed 
at the same time as the reproduction of the norma! voice 
is delayed or the sub-picture is displayed with a some 
delay In learning a language, for example, a listener 55 
can listen first without any hint and then confirm it later. 

? The second embodiment of this invention will now 
be described, centering on the modified parts which dif- 

' : l , • ;.f. ,' 



fer from the first embodiment, with reference to FIGS. 
43A to 43C and FIGS. 44 to 46. 

According to the second embodiment, the delay 
time Td for delaying sub-picture data is preset in the 
reproducing apparatus. 

In this embodiment, the start PTS described in the 
sub-picture unit as sub-picture data on the optical disk 
10 is the same as the PTS's of video data and audio 
data which are to be processed in the same time slot. 

FIG. 44 presents a block diagram of an optical disk 
reproducing apparatus for explaining the second 
embodiment. 

TTie delay time Td for delaying sub-picture data is 
previously stored In the system ROM and RAM section 
52 or the internal memory (not shown) of the system 
CPU section 50. Accordingly, the delay time Td read 
from the system ROM and RAM section 52 by the sys- 
tem CPU section 50 is supplied to the buffer con- 
trol/STC control section 57. 

FIGS. 45A through 45M show a timing chart for 
explaining the relationship among an input clock, output 
dock, PTS and DTS for use in the reproduction of video 
data, audio data and sub-picture data. FIGS. 45A-45J 
are identical to FIGS. 36A through 36J. 

The buffer control/STC control section 57 sends the 
start PTS and stop PTS with respect to the sub-picture 
data, supplied from the system processor section 54, to 
the sub-picture decoder section 62 with the delay time 
Td, and also delays one unit of output clocks to be sent 
to the sub-picture buffer section 63 by the delay time Td. 

The start PTS and stop PTS for the sub-picture 
data supplied from the system processor section 54 are 
shown in FIG. 45K, the start PTS and stop PTS for the 
sub-picture data, which are to be delayed by the delay 
time Td, are shown in FIG. 45L and one unit of output 
clocks for the sub-picture data, which are to be delayed 
by the delay time Td, are shown in FIG. 45M. 

The playback operation of this structure will now be 
discussed referring to the timing chart shown in FIGS. 
45A-45M and the flowchart illustrated in FIG. 46. 

As Indicated In step S41 , the system processor sec- 
tion 54 sequentially reads the pack data, which is to be 
reproduced in the same time slot as the playback time 
set in the STC timer 54a, from the data RAM section 56 
by referring to the SCR given to the pack header, deter- 
mines the packet type described in the packet header in 
that pack, and sends the packet data determined as the 
main picture to the video buffer section 59 as video 
data, the packet data determined as the audio data to 
the audio buffer section 61 as audio data, and me 
packet data determined as the sub-picture to the sub- 
picture buffer section 63 as sub-picture data in accord- 
ance with the determined packet type. 

As depicted in step S42, the system processor sec- 
tion 54 6ends the time set in the STC timer 54a (SCR as 
the playback time), the DTS and PTS, described in the 
packet header of the head pack of the video data, the 
PTS, described in the packet header o1 the head pa* of 
the audio data, and the start PTS and stop PTS, which 
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are specified by the display control command (OCSQ) 
and are included in the PTS, described in the packet 
header of the head pack of the sub-picture data, to the 
buffer contro!/STC control section. 57. The system CPU 
section 50 supplies the delay time'Td for the sub-picture $ 
data, read from the system ROM and RAM section 52 p 
to this buffer control/STC control section 57. 

The buffer control/STC control section 57 sets the 
supplied SCR as the playback time in the STC timer 58a 
of the video decoder section 58, the STC timer 60a of to 
the audio decoder section 60 and STC timer 62a of the 
sub-picture decoder section 62 as specif ied in step S43. 

Further, the buffer control/STC control section 57 
outputs the input clock to the video buffer section 59 
when packet data of the video data is sent to the video 
buffer section 59 from the system processor section 54, 
outputs the input clock to the audio buffer section 61 
when the packet data of the audio data is sent to the 
audio buffer section 61 from the system processor sec- 
tion 54, and outputs the input dock to the sub-picture 
buffer section 63 when the packet data of the sub-pic- 
ture data is sent to the sub-picture buffer section 63 
from the system processor section 54. ' 

As a result, the video buffer section 59, audio buffer 
section 61 and sub-picture buffer section 63 store the 25 
supplied data in response to the input clock as indicated 
instepS44. ! » " j. 

When the STC in the STC timer 57a matches with 
the DTS of the video data, the buffer controt/STC control 
section 57 outputs one unit of output clocks to the video 
buffer section 59. When the STC in the STC timer 58a 
in the videodecoder section 58 matches with the DTS in 
the register 58b, the decoder 56f starts decoding based 
on the output of the comparator 58d. 

Consequently, the video data output from the video 
buffer section 59 in accordance with the output dock is 
decoded by the decoder 58f as described in step S45. 

As is apparent from step S46, when the STC in the 
STC timer 58a in the video decoder section 58 matches 
with the PTS in the register 53c, the decoded output of 
the decoder 58f is sent to the video D/A section 66 via 
the mixing section 64 based on the output from the com- 
parator 58e. | . 

When the STC in the STC timer 57a matches with 
the PTS in the audio data, the buffer control/STC control 
section 57 outputs one unit of output clocks to the audio 
buffer section 61 . When the STC in the STC timer 60a 
in the audio decoder section 60 matches with the PTS in 
the register 60b, the decoder 60d also starts decoding 
based on the output of the comparator 60c. 

Consequently, as depicted in step S47, the audio 
data output from the audio buffer section 61 in accord- 
ance with the output clock is decoded by the decoder 
60d and the decoded output is then sent to the audio 
D/A section 68. j ! ** 

After a predetermined time has passed, i.e.. when 
the delay time Td elapses after trie matching of the STC 
in the STC timer 57a with the start PTS of the sub-pic- ; 
ture data, the buffer contrd/STC control section 57 out- 
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puts one unit of output docks to the sub-picture buffer 
section 63. When the STC in the STC timer 62a in the 
sub-picture decoder section 62 matches with the start 
PTS delayed by the delay time Td in the register 62b, 
the decoder 62f starts decoding based on the output of 
the conrparator 62d. . 1 

Consequently, as indicated in step S48. the sub- 
picture data output from the sub-picture buffer section 
63 in accordance wrth the output clock is decoded by 
the decoder 62f and the decoded output is then mixed 
with the video data in the mixing section 64. The result- 
ant data is then 6ent to the video D/A section 66. 

When the STC in the STC timer 62a in the sub-pic- 
ture decoder section 62 matches with the stop PTS 
delayed by the delay time Td in the register 62c, the 
decoder 62f stops decoding based on the output of the 
comparator 62e. 

Accordingly, as specified in step S49. the decoder 
62f in the sub-picture decoder section 62 stops output- 
ting the decoded data. 

Consequently, the image corresponding to the 
video data is displayed on the monitor section 6 and the 
voice corresponding to the audio data is reproduced 
from the speaker section 8. After a predetermined time 
dday. the mixed image corresponding to the sub-picture 
data and video data is displayed on the monitor section 
6. Thereafter, the sub-picture data wilt disappear. 

At the first timing, therefore, the image of a teacher 
saying "ONE" is displayed as the main picture on the 
monitor section 6 and the teacher's voice *ONE* is 
reproduced from the speaker section 8, as shown in 
FIG. 43A. At the next timing, as shown in FIG. 43B, the 
image of the teacher pronounting "ONE" is displayed as 
the main picture on the monitor section 6 and the super* 
irrposition "ONE" as the sub-picture is superimposed 
on the main picture. At this timing, an apprentice as a 
listener should pronounce the word. At the next timing, 
as shewn in FIG. 43C, the image of the teacher saying 
"GOOD" is displayed as the main picture on the monitor 
section 6 and the teacher's voice "GOOD" is repro- 
duced from the speaker section 8. 

The third embodiment of this invention will now be 
discussed with reference to FIGS. 43A through 43C. 
FIG. 44, FIGS. 45A through 45M, and FIGS. 47A. 47B 
and 48. The delay time at which the subpicture data is 
reproduced with respect to the main picture data is pre- 
set in the reproducing apparatus in the second embed- 
ment, whereas a user can freely set the delay time 
using the key/display section 4 and what is displayed on 
the monitor section 6 in the third embodiment. The 
key/display section 4 may be. constituted of a remote 
controller, tor example. 

For instance, the basic menu screen tor setting the 
delay time as shewn in FIG. 47A is displayed on the 
monitor section 6. and a user selects 'DELAY SET for 
setting the delay time from among the selections 
TITLE," "LANGUAGE" and "DELAY SET" on the base 
menu screen using the key/display section 4. Then, the 
delay time setting screen as shown in FIG. 47B ts ds- 
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played on the monitor section 6. Using the key/display 
section 4, the user selects, for example, "SUB-PIC- 
TURE" from "VIDEO; /'AUDIO" and "SUB-PICTURE" 
on the delay time setting screen, as the type for which 
the delay time is to be set, and then sets the delay time 
(seconds) through the time setting section on that 



screen. 
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\ The playback operation of this structure will now be 
discussed referring to the timing chart shown in FIGS. 
45A-45M and the flowchart illustrated in FIG. 48. . 

\ First, the basic menu screen for setting the delay 
time as shown in FIG. 47A is displayed on the monitor 
section 6 as Indicated 'in step S50. The user then 
selects "DELAY SET" for setting the delay time from 
among "TITLE" "LANGUAGE" and "DELAY SET on 
the basic menu screen using the key/display section 4 
as indicated in step S51. : 

i: Consequently, the time setting screen for each type 
to be deiayed (hereinafter referred to as "type-by-type 
delay time setting screen") as shown in FIG. 47B is dis- 
played on the monitor section 6 as indicated in step 
S52. Then, using the key/display section 4, the user 
selects/for example, "SUB-PICTURE" from among 
"VIDEO," "AUDIO" and ?SUB-PICTURE" on the type- 
by-type delay time setting screen, as the type for which 
the delay time is to be set, and then sets the delay time 
(seconds) through the time setting section on that 
screen as depicted in step S53. 

Then, as indicated in step S54, the system proces- 
sor section 54 sequentially reads the pack data, which 
is to be reproduced in the same time slot as the play- 
back time set in the STC timer 54a, from the data RAM 
section 56 by referring to the SCR given to the pack 
header; determines the packet type described in the 
packet header in that pack, and sends the packet data 
determined as the main picture to the video buffer sec- 
tion 59 as video data, the packet data determined as the 
audio data to the audio buffer section 61 as audio data, 
and the packet data determined as the sub-picture to 
the sub-picture buffer section 63 as sub-picture data in 
accordance with the determined packet type. 
: ; As depicted in step S55, the system processor sec- 
tion 54 sends the time set in the STC timer 54a (SCR as 
the playback time), the DTS and PTS, descrfoed in the 
packet header of the head pack of the video data, the 
PTS, described In the packet header of the head pack of 
the audio data r and the start PTS and stop PTS, which 
are specified by the display control command (DCSQ) 
and are included in the PTS, described in the packet 
header of the head pack of the sub-picture data, to the 
buffer control/STC control section 57. The system CPU 
section 50 supplies the type targeted for the delay, set 
by the key/display section 4, the delay time Td for the 
sub-picture data, read from the system ROM and RAM 
section 52, to this buffer control/STC control section 57. 

l The buffer control/STC control section 57 sets the 
supplied SCR as the playback time in the STC timer 58a 
of the video decoder section 58, the STC timer 60a of 



the audio decoder section 60 and STC timer 62a of the 
sub-picture decoder section 62 as specified in step S56. 

Further, the buffer control/STC control section 57 
outputs the input clock to the video buffer section 59 

5 when packet data of the video data is sent to the video 
buffer section 59 from the system processor section 54, 
outputs the input clock to the aucBo buffer section 61 
when the packet data of the audio data is sent to the 
audio buffer section 61 from the system processor sec- 

io tion 54, and outputs the input clock to the sub-picture 
buffer section 63 when the packet data of the sub-pic- 
ture data is sent to the sub-picture buffer section 63 
from the system processor section 54. 

As a result, the video buffer section 59, audio buffer 

is section 61 and sub-picture buffer section 63 store the 
supplied data in response to the input clock as indicated 
instepS57, 

When the STC in the STC timer 57a matches with 
the DTS of the video data, the buffer control/STC control 

so section 57 outputs one unit of output clocks to the video 
buffer section 59. When the STC in the STC timer 58a 
in the video decoder section 58 matches with the DTS in 
the register 58b, the decoder 58f starts decoding based 
on the output of the comparator 58d. 

25 Consequently, the video data output from the video 
buffer section 59 in accordance with the output clock is 
decoded by the decoder 58f as described in step S58. 

As is apparent from step S59, when the STC in the 
STC timer 58a in the video decoder section 58 matches 

so with the PTS in the register 58c, the decoded output of 
the decoder 58f is sent to the video D/A section 66 via 
the mixing section 64 based on the output from the com- 
parator 58e. 

When the STC in the STC timer 57a matches with 
35 the PTS in the audio data, the buffer control/STC control 
. section 57 outputs one unit of output clocks to the audio 
buffer section 61. When the STC in the STC timer 60a 
in the audio decoder section 60 matches with the PTS in 
the register 60b, the decoder 60d also starts decoding 
40 based on the output of the comparator 60c. 

Consequently, as depicted In step S60. the audio 
data output from the audio buffer section 61 In accord- 
ance with the output clock is decoded by the decoder 
60d and the decoded output is then sent to the audio 
45 . D/A section 68. 

After a predetermined time has passed, i.e., when 
the delay time Td elapses after the matching of the STC 
• in the STC timer 57a with the start PTS of the sub-pic- 
ture data, the buff er control/STC control section 57 out- 
so puts one unit of output clocks to the sub-picture buffer 
section 63. When the STC in the STC timer 62a in the 
sub-picture decoder section 62 matches with the start 
PTS delayed by the delay time Td in the register 62b, 
the decoder 62f starts decoding based on the output of 
55 the comparator 62d. 

Consequently, as indicated in step S61, the sub- 
picture data output from the sub-picture buffer section 
63 in accordance with the output clock is decoded by 
the decoder 62f and the decoded output is then mixed 
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with the video data in the mixing section 64. The result- 
ant data is then sent to the video D/A section 66. j 

When the STC in the STC timer 62a in the sub-pic- 
ture decoder section 62 matches with the stop PTS 
delayed by the delay time Td in the register 62c, the 
decoder 62f stops decoding based on the output of the 
comparator 62e. , s i. j 

Accordingly, as specified in step S62, the decoder 
62f in the sub-picture decoder section 62 stops output- 
ting the decoded data. | 

Consequently the image corresponding to the 
video data is displayed on the monitor section 6 and the 
voice corresponding to the audio data Is reproduced 
from the speaker section 8. After a predetermined time 
delay, the mixed image corresponding to the sub-picture 
data and video data is displayed on the monitor section 
6. Thereafter, the sub-picture data will disappear, j 

At the first timing, therefore, the image of a teacher 
saying "ONE" is displayed as the main picture on the 
monitor section 6 and the teachers voice "ONE" is 
reproduced from the speaker section 8, as shown in 
FIG. 43A. At the next timing, as shown In FIG. 43B, the 
image of the teacher pronouncing f ONE" is displayed as 
the main picture on the monitor section 6 and the super- 
imposition "ONE" as the sub-picture is superimposed 
on the main picture. At this timing, an apprentice as a 
listener should pronounce the word. At the next timing, 
as shown in FIG. 43C. the image 'of the teacher saying 
"GOOD" te displayed as the main picture on the monitor 
section 6 and the teacher 1 * voice "GOOD* is repro- 
duced from the speaker section 8. ; 

Although the foregoing description of this embodi- 
ment has been given with reference to the case where 
sub-picture data is delayed, this invention may also be 
adapted to the case where main picture data or audio 
data is delayed. I j 

The fourth embodiment of this invention will now be 
described referring to FIG. 1, FIGS. 49A through 49N, 
FIG. 50 and FIGS. 51 A through 51 C. According to the 
fourth embodiment, by utilizing the fact that the display 
period of a sub-picture which is expressed by using the 
start PTS and stop PTS of a sub-picture unit corre- 
sponds to one phrase of the normal speech, the display 
timing of a sub-picture is delayed by one phrase and 
during the display of this sub-picture, the main picture 
and voice are stopped or frozen. ; \ 

In this embodiment, the start PTS described in the 
6ub-picture unit as sub-picture data on the optical disk 
10 is the same as the PTS's of video data and audio 
data which are to be processed in the same time slot. 

FIGS. 49A through 49M show a timing chart for 
explaining the relationship among : an input clock, output 
clock, PTS and DTS for use in the reproduction of video 
data, audio data and sub-picture' data. FIGS. 49A-49F 
are identical to FIGS. 36A through 36R ! 

The buffer control/STC control section 57 delays 
the start PTS and stop PTS with inspect to the sub-pic- 
ture data, supplied from the system processor section 
54, by the delay time Td corresponding to one phrase 



computed from the difference between the start PTS 
and stop PTS. and outputs the delayed start PTS and 
stop PTS to the sub-picture decoder section 62, and 
also delays one unit of output docks to be sent to the 

5 sub-picture buffer section 63 by the delay time Td. 

The start PTS and stop PTS for the sub-picture 
data supplied from the system processor section 54 are 
shown in FIG. 49K, the start PTS and stop PTS for the 
sub-picture data, which are to be delayed by the delay 

10 time Td. are shown in FIG. 49L and one unit of output 
docks for the sub-picture data, which are to be delayed 
by the delay time Td. are shown in FK2L49M. i 

During the period from the start PTS for the sub- 
picture data output with the delay time Td to the stop 

is PTS, the buffer control/STC control section 57 outputs a 
stop signal to the STC timer 58a in the video decoder 
section 58 and the STC timer 60a in the aurfo decoder 
section 60. 

In other words, the buffer controt/STC control sec- 
so tion 57 stops the STC timers 58a and 60a in accordance 
with the start PTS delayed by the delay time Td. and 
sets the time leading by the delay time Td from the STC 
corresponding to the start PTS delayed by the delay 
time in the STC timers 58a and 60a in accordance with 
25 the stop PTS. 

While a sub-picture is being displayed, freezing the 
video and audio data is carried out 

The playback operation of this structure will now be 
discussed referring to the timing chart shown in FIGS. 
30 49A-49N and the flowchart illustrated in FIG. 50. 

As indicated in step S71 1 the system processor sec- 
tion 54 sequentially reads the pack data, which is to be 
reproduced in the same time slot as the playback time 
set in the STC timer 54a, from the data RAM section 56 
35 by referring to the SCR given to the pack header, deter- 
mines the packet type described in the packet header h 
that pack, and sends the packet data determined as the 
main picture to the video buffer section 59 as video 
data, the packet data determined as the audio data to 
40 the audio buffer section 61 as audio data, and the 
packet data determined as the sub-picture to the stf>- 
picture buffer section 63 as sub-picture data in accord- 
ance with the determined packet type. 

As indicated in step S72, the system processor sec- 
45 tion 54 sends the time set in the STC timer 54a {SCR as 
the playback time), the DTS and PTS. desatoed in the 
packet header of the head pack of the vkJeo data, the 
PTS, described in the packet header of the head pack of 
the autfo data, and the start PTS and stop PTS. which 
so are specified by the display control command PCSQ) 
and are included in the PTS. descrtoed in the packet 
header of the head pack of the sub-picture data, to the 
buffer control/STC control s ection 57. 

The buffer control/STC control section 57 sets the 
55 supplied SCR as the playback time in the STC timer 58a 
of the video decoder section 58. the STC timer 60a of 
the audio decoder section 60 and STC timer 62a of the 
sub-picture decoder section 62 as indicated in step S73- 
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• \ The buffer control/STC control section 57 computes 
th^ delay time Td corresponding to one phrase from the 
difference between the start PTS and stop PTS for the 
sub-picture data. j; 

'{ Further, the buffer control/STC control section 57 
ouiputs the input clock to the video buffer section 59 
when packet data of the video data is sent to the video 
buffer section 59 from the system processor section 54, 
outputs the input clock to the audio buffer section 61 
when the packet data of the audio data is sent to the 
aidio buffer section 61 from the system processor sec- 
tion 54, and outputs the input dock to the sub-picture 
buffer section 63 when the packet data of the sub-pic- ; 
ture data Is sent to the: sub-picture buffer section 63 
from the system processor section 54. 

] As a result, the video buffer section 59, audio buffer 
section 61 and sub-picture buffer section 63 store the 
supplied data in response to the input clock as indicated 
instep S74.\ : f 

\ : When the STC in the STC timer 57a matches with 
tte DTS of the video data, the buffer control/STC control 
section 57 outputs one unit of output clocks to the video 
buffer section 59. When the STC in the STC timer 58a 
in the video decoder section 58 matches with the DTS in 
the register 58b, the decoder 58f starts decoding based 
on the output of the comparator 58d. = 

■ Consequently, the video data output from the video 
buffer section 59 in accordance with the output clock is 
decoded by the decoder 58f as indicated in step S75. 
.: As is apparent from step S76, when the STC jn the 
STC timer 58a in the video decoder section 58 matches 
with the PTS in the register 58c, the decoded output of 
the decoder 58f is sent to the video D/A section 66 via 
the mixing section 64 based on the output from the com- 
parator 58e. , { 

' When the STC in the STC timer 57a matches with 
the PTS in the audio data, the buffer control/STC control ; 
section 57 outputs one unit of output clocks to the audio 
buffer section 61. When the STC in the STC timer 60a 
in the audio decoder section 60 matches with the PTS in 
the register 60bi the decoder 60d also starts decoding 
based on the output of the comparator 60c, 

x Consequently, as indicated in step S77, the audio 
data output from the audio buffer section 61 in accord- 
ance with the output clock is decoded by the decoder 
60d and the decoded output is then sent to the audio 
D/A section 68. ; j : 

After a predetermined time has passed, i.e., when 
the computed delay time Td elapses after the matching 
of the STC in the STC timer 57a with the start PTS of 
the sub-picture data, the buffer control/STC control sec- 
tion 57 outputs one unit of output clocks to the sub-pic- 
ture buffer section 63.. When the STC in the STC timer 
62a in the sub-picture decoder section 62 matches with 
the start PTS delayed by the delay time Td in the regis- 
ter 62b, the decoder 62f starts decoding based on the 
output of the comparator 62d, 

: Consequently, as indicated, in step S78, the sub- 
picture data output from the sub-picture buffer section 



63 in accordance with the output clock is decoded by 
the decoder 62f and the decoded output is then mixed 
with the video data in the mixing section 64. The result- 
ant data is then sent to the video D/A section 66. 

5 At this time, the buffer control/STC control section 
57 supplies a stop signal to the STC timer 58a in the 
video decoder section 58 and the STC timer 60a in the 
audio decoder section 60. Consequently, decoding by 
the decoder 58f and decoding by the decoder 60d stop 

10 and the video image on the screen when the decoding 
operations are stopped Is displayed on the monitor sec- 
tion 6 with no sounds generated. 

When the STC In the STC timer 62a in the sub-pic- 
ture decoder section 62 matches with the stop PTS 

1$ delayed by the delay time Td in the register 62c, the 
decoder 62f stops decoding based on the output of the 
comparator 62e. 

At this time, the buffer controt/STC control section 
57 sets the time leading by the delay time Td from the 

20 STC corresponding to the start PTS. delayed by the 
: delay time Tdjn the STC timer 58a in the video decoder 
section 58 and the STC timer 60a in the audio decoder 
section 60. As a result, the decoders 58! and 60d restart 
decoding. 

25 Accordingly, as indicated in step S79, the decoder 
62f in the sub-picture decoder section 62 stops output- 
ting the decoded data, and the decoded output of the 
decoder 58f is supplied to the video D/A section 66 via 

* the mixing section 64 while the decoded output of the 

30 decoder 60d is supplied to the audio D/A section 68. 
Consequently, the image corresponding to the 
video data is displayed on the monitor section 6 and the 
voice corresponding to the audio data is reproduced 
from the speaker section 8. After a predetermined time 

35 delay corresponding to one phrase, the mixed image 
corresponding to the sub-picture data and video data is 
displayed on the monitor section 6. At this time, the 
video and audio data are frozen. Thereafter, the sub- 
picture data will disappear and the video and audio data 

40 are reproduced from that time. 

At the first tinting, therefore, the Image of a teacher 

saying "ONE" Is displayed as the main picture on the 
monitor section 6 and the teacher's voice "ONE* is 
reproduced from the speaker section 8, as shown in 
45 FIG. 51 A. At the next timing, as shown in FIG. 51 B, the 
image of the teacher having said "ONE" and the super- 
imposition "ONE" as the sub-picture are displayed in the 
superimposing manner on the monitor section 6. At this 
' timing, an apprentice as a listener should pronounce the 
so word. At the next timing, as shown in FIG. 51 C, the 
image of the teacher saying "GOOD" is displayed as the 
main picture oh the monitor section 6 and the teacher's 
voice "GOOD" is reproduced from the speaker section 
8. 

55 As a result, at the time of learning a language, a 
student can make a pronunciation while referring to the 
superimposition after the pronunciation by the teacher. 

As shown in FIGS. 52A-52C, the superimposition 
as a sub-picture may be displayed previously, the main 
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picture and sound may be frozen for the display period 
of this sub-picture, and the main picture and sound may 
be reproduced after the display of the sub-picture is 
completed. j j ■ j 

First at the first timing, the picture of the teacher is 
displayed on the monitor section 6 as the main picture 
as shown in FIG. 52A. At the next timing, the image of 
the teacher still on the screen as the main picture and 
the superimposition "TWO" as' the sub-picture are 
superimposed on the monitor section 6 as shown in 
FIG. 52B. At this timing, an apprentice as a listener is 
expected to make a pronunciation. At the next timing, 
the image of the teacher saying "TWO* is displayed on 
the monitor section 6 and the teacher's voice TWO" is 
reproduced from the speaker section 8. as shown in 
FIG. 52C. | 

In this case, the delay times for the main picture and 
sound may be set from the menu and delaying may be 
executed accordingly, or delaying may be done by the 
time specified by the 6tart PTS and stop PTS for the 



sub-picture unit. 



I s 



As shown in FIGS. 53A-53C,:the sound for only the 
phrase portion may be delayed and then reproduced, 
the main picture and the superimposition as the sub- 
picture may be frozen for the playback period of this 
sound, and the main picture and sound may be repro- 
duced after the sound reproduction is completed, j 

First at the first timing, the picture of the teacher as 
the main picture *od the superimposition THREE" as 
the sub-picture are superimposed on the monitor sec- 
tion 6 as shown in FIG. 53A. At this timing, the appren- 
tice as a listener is expected to make a pronunciation. At 
the next timing, the image of the teacher pronouncing 
"THREE* is displayed on the monitor section 6 and the 
teacher's voice THREE" is reproduced from the 
speaker section 8, as shown in FIG. 53B. At the next 
timing, as shown in FIG. 54C, the image of the teacher 
saying "GOOD" as the main picture is displayed on the 
monitor section 6 and the teacher's voice "GOOD" is 
reproduced from the speaker section 8. f 

In this case, the delay times for the main picture and 
sound may be set from the menu and delaying may be 
executed accordingly, or delaying may be done by the 
time specified by the start PTS and stop PTS for the 
sub-picture unit, as the phrase period. 

As shown in FIGS. 54A-54C. when the first sound 
and second sound are present in addition to the main 
picture and sub-picture, the second sound may be 
reproduced with a delay, the main picture, the superim- 
position as the sub-picture and the first sound may be 
frozen for the playback period of the second sound, and 
the main picture, the sub-picture and the first sound 
may be reproduced after the reproduction of the second 
sound is completed. / 

At the first timing, the image of the teacher saying 
"FOUR" as the main picture and the superimposition 
"FOUR" as the sub-picture are!superimposed on the 
monitor section 6, and the first .voice "FOUR" by the 
teacher is reproduced from the speaker section 8, as 



shown in FIG. 54A. At the next timing, as shewn in FIG. 
54B. the image of the teaching having said TOUR" as 
the main picture is kept displayed on the monitor section 
6, and the second voice *YON* (in Japanese) by the 

5 teacher is reproduced from the speaker section 8. At 
this timing, an apprentice as a listener can know the 
translation of the English wad. At the next timing, as 
shown in FIG. 54C. the image of the teacher saying 
"GOOD" as the main picture is displayed on the monitor 

to section 6 and the teachers first voice "GOOD* is repro- 
duced from the speaker section 8. 

As a resuft. the student can listen to the translation 
of the conversation at the delayed timing at the time of 
learning the language. ! 

is In this case, the delay times of the main picture, 
sub-picture and the first sound may be set from the 
menu, or delaying may be done by the time specified by 
the start PTS and stop PTS for the sub-picture unit 
As shown in FIGS. 55A-65C, when the first sound 

so and second sound are present in addition to the main 
picture and sub-picture, the first sound and the superim- 
position as the sUb-picture may be reproduced wrih a 
certain delay, the main picture and the second sctmd 
may be frozen for the playback period of the first sound 

2$ and the sub-picture, and the main picture and the sec- 
ond sound may be reproduced after the reproduction of 
the first sound and sub-picture is conpleted. 

At the first timing, as shown in FIG. 55A, the image 
of the teacher saying "GO" {in Japanese) as the main 

30 picture is displayed on the monitor section 6, and the 
second voice "GO" by the teacher is reproduced from 
the speaker section 8. At the next timing, as shown in 
FIG. 55B, the image of the teaching having said "GO* as 
the main picture and the superimposition "FIVE* as the 

35 sub-picture are superimposed on the monitor section 6, 
and the first voice "FIVE" by the teacher is reproduced 
from the speaker section 8. At this timing, an apprentice 
as a listener can know the translation of the Engfish 
word. At the next timing, as shown in FIG. 55C. the 

40 image of the teacher saying "GOOD" as the main pic- 
ture is displayed on the monitor section 6 and the 
teacher's first voice "GOOD" is reproduced from the 
speaker section 8. 

As a result, the student can listen to the translation 

45 of the conversation at the delayed timing at the time of 
learning the language. j 

In this case, the delay times of the first sound and 
the sub-picture may be set from the menu, or delaying 
may be done by the time specified by the start PTS and 

50 stop PTS for the sub-picture unit 

As shown in FIGS. 56A-5SC. when the first sub-pic- 
ture and second sub-picture are present in addition to 
the main picture and sound, the second sub-picture 
may be reproduced with a certain delay, the main pic- 

55 ture and sound may be frozen for the playback period of 
the second sub-picture, and the main picture and sound 
may be reproduced after the reproduction of the second 
sub-picture is completed. 
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i At the first timing, as shown in FIG. 56A, the image 
of the teacher' saying "SIX" as the main picture and the 
superimposition "SIX" as the first sub-picture are super- 
imposed on the monitor section 6, and the teacher's 
voice "SIX" is reproduced from the speaker section 8. At ; s 
the next timing, as shown in FIG. 56B, the image of the 
teaching having said "SIX" as the main picture and the 
superimposition "ROKU":(in Japanese) as the second . 
sub-picture or translation are superimposed on the 
monitor section 6. At this timing, an apprentice as a lis- V io 
terier can know the translation of the English word. At 
the next timing, as shown in FIG. 56C, the image of the 
teacher saying "GOOD" as the main picture is displayed 
on. the monitor section's and the teacher's voice 
"GOOD" is reproduced from the speaker section 8. 15 

[ As a" result, the student can listen to the translation 
of the conversation at the delayed timing at the time of 
learning the language, f 

; In this case, the delay time of the second sub-pic- 
ture may be set from the menu, or delaying may be 20 
done by the time specified by the start PTS and stop 
PTS for the sub-picture unit of the second sub-picture. 

Alternatively, the first and second sub-pictures may 
be displayed simultaneously, in which case separate 
display positions should be set for the first and second 2$ 
sub-pictiires or the display colors should be changed for 
the distinction. ■ j 

r Instead of delaying sub-picture data, the sub-pic- 
ture data may be displayed as if hidden by a mosaic or 
black filling for the delay time. 

i In this case, as shown in FIG. 57, a digital signal . 
processor (DSP) 65 which selectively turns the sub-pic- 
ture data from the sub-picture decoder section 62 into a 
mosaic pattern or painting the data with black is pro- 
vided between the sub-picture decoder section 62 and 35 
the mixing section 64 in the structure In FIG. 1 . 

[■ In the case where ah 8 x 8 dot mosaic is to be gen- 
erated, this DSP 65 comprises a first sample and hold 
section tor sampling and holding data input dot by dot, a 
first line memory for storing the output of the first sam- 40 
pie and hold section, a second sample and hold section : 
for sampling and holding the output of the first line mem- : 
ory for one line, a secortd line memory for storing one 
line of data from the second sample and hold section, a 
first frequency divider ;f or sending a timing signal,- as 
obtained by dividing the horizontal dot clock by 8, to the ' 
first sample and hold section, and a second frequency 
divider for sending a timing signal, obtained by dividing 
the vertical syno 6ignal by 8, to the second sample and 

hold section. j 60 

At the first timing, as shown in FIG/58A, the image 

of the teacher saying "ELEVEN" as the main picture and 
the superimposition "ELEVEN" as the 6ub-picture which 
has been turned to a mosaic pattern by the DSP 65 are 
superimposed on the -monitor section 6, and the s$ 
teacher's voice "ELEVEN" is reproduced from the 
speake^ section 8. At the next timing, as shown in FIG.- 
58B, the image of the teacher saying "GOOD" and the 
superimposition "ELEVEN" as the sub-picture are 
■ . r: ' : . ! i 



superimposed on the monitor section 6 and the 
teacher's voice "GOOD" is reproduced from the speaker 

"me reproduction of the no-sound period between 
phrases may be skipped. 

A spedal reproduction, such as a strobe effect or 
afterimage effect, may be accomplished by performing 
predetermined data processing on the main picture 
data, delayed in the above-described manner, and com- 
bining the processed main picture data with main pic- 
ture with the zero delay time. 

Next, the video data in the logic formats shown in 
FIGS. 4 to 31, a method of recording data on the optical 
disk 10 to reproduce the video data, and a recording 
system to which the recording method is applied will be 
explained with reference to FIGS. 59 to 64. 

FIG. 59 shows an encoder system that creates a 
video file of a title set 84 in which the video data is 
encoded. In the system of FIG. 59, for example, a vide- 
otape recorder (VTR) 201, an audiotape recorder (ATR) 
202, and a sub-picture source 203 are used as sources 
of the main video data, the audio data, and the sup-pic- 
ture data. Under the control of a system controller (Sys 
con) 205, they create the main video data, audio data, 
and sup-picture data, which are supplied to a video 
encoder (VENC) 206, an audio encoder (AENC) 207, 
and a sub-picture encoder (SPENC) 208. respectively. 
Under the control of the system controller (Sys con) 
205, these encoders 206, 207, and 208 perform A/D 
conversion of the main video data, audio data, and sup- 
picture data and encode them by the respective com- 
pression schemes. The encoded main video data, audio 
data, and sub-picture data (Comp Video, Comp Audio, 
Comp Sub-pict) are stored in memories 210, 211, and 
212. The main video data, audio data, and sub-picture 
data (Comp Video, Comp Audio, Comp Sub-pict) are 
outputted to a file formatter (FFMT) 214 under the con- 
trol of the system controller (Sys con) 205, which con- 
verts them so that they may have a file structure of video 
data for the system as explained earlier. Then, under 
the control of the system controller (Sys con) 205, the 
setting conditions for each data item and the manage- 
ment information including attributes are stored in a 
memory 21 6 in the form of files. 

Explained next will be a standard flow of an encod- 
ing process in the system controller (Sys con) 205 that 
creates a file from video data. 

According to the flow of FIG. 60. the main video 
data and the audio data are encoded and the encoded 
main video data and audio data (Comp Video, Comp 
Audio) are supplied. Specifically, when the encoding 
process is started, as shown in step S70 of FIG. 60, the 
parameters necessary for encoding the main video data 
and audio data are set Part of the set parameters are 
stored in the system controller (Sys con) 205 and at the 
same time, are used at the file formatter (FFMT) 21 4. As 
shown in 6tep S271 , the main video data is pre-encoded 
using the parameters and the optimum distribution of 
the amount of codes is calculated. Then, on the basis of 
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the code amount distribution obtained in the pre-encod- 
ing, the main video data is encoded as shown in step 
S272. At the same time, the audio data is also encoded 
at step S272. As shown in step in S273, if necessary, 
the main video data is partially encoded again and the 
reencoded portion of the main video data is replaced 
with the old one. Through the series of steps, the main 
video data and audio data are encoded. Furthermore, 
as shown in steps S274 and S275. the sub-picture data 
is encoded and the encoded sub-picture data {Comp 
Sub-pict) is supplied. Namely, the parameters neces- 
sary for encoding the sub-picturedata is set. As shown 
in step S274, part of the parameters are stored in the 
system controller (Sys con) 205 and used in the file for- 
matter (FFMT) 214. On the basis of the parameters, the 
sub-picture data is encoded. By the process, the sup- 
picture data is encoded, j I " I 

According to the flow of FIG. 61 , the encoded main 
video data, audio data, and sup-picture" data (Com 
Video, Com Audio, Comp Sub-pict) are mixed and con- 
verted 60 as to form a video data title set structure as 
explained tn FIGS. 4 and 12. Specifically, as shown in 
step S276. a cell is set as the smallest unit of the video 
data and cell playback information on a cell (C_PBI) is 
created. Then, as shown in step S277, the structure of 
the cells constituting a program chain and the main 
video, sub-picture, and audio attributes (the information 
obtained in encoding the respective data items are used 
part of these attributes) are set and the video title set 
information management table information (VTSI_MAT) 
98 containing information on a program chain and a 
video title set time search map table (VTSJAAPT) 142 
are created. At this time, as the need arises, a video title 
set direct access pointer table (VTSJDAPT) is also cre- 
ated. The encoded main video data, audio data, and 
sup-picture data (Com Video. Comp Audio, Comp Sup- 
pict) are subdivided into specific packs. An NV pack is 
placed at the head of each VOBU unit so that playback 
can be effected in the order of time code of each data 
item. With the NV packs arranged this way, each data 
cell is positioned so that a video object (VOB) may be 
composed of a plurality of cells as shown in FIG. 6. A 
set of such video objects is formatted into the title set 
structure. : i • I 

Time stamps like PTS and DTS are described in 
- each pack ■ ! 

According to the first embodiment, descrfoed in the 
PTS of a sub-picture, for example, is a time arbitrarily 
delayed from the PTS of main picture data or audio data 
which is to be reproduced in the same time slot as the 
sub-picture. j 

According to the 6econd and other embodiments, 
the same time as described in the PTS of main picture 
data or audio data which is to' be reproduced in the 
same time slot is described in ttie PTS of a sub-picture. 

In the flow of FIG. 61, the program chain informa- 
tion (PGI) is obtained in the process of step S277 by 
using the database in the system controller (Sys con) 
205 or entering data again as the need arises, j 



FIG. 62 shows a disk formatter system that records 
on an optical disk the title set formatted as described 
above. In the disk formatter system of FIG. 48, the 
memories 220, 222 in which the created title set is . 
5 stored supply these file data Hems to a volume formatter 
(VFMT) 226. In the volume formatter (VFMT) 225 
extracts the management information from the title sets 
84, 86. produces a video manager 71. and create the 
logic data to be recorded on the disk 10 in the arrange- 
jo ment of FIG. 4. A disk formatter (DFMT) 228 adds error 
correction data to the logic data created at the volume 
formatter (VFMT) 226, thereby reconverting the logic 
data into physical data to be recorded on the disk A 
modulator 230 converts the physical data created at the 
j 5 disk formatter (DFMT) 228 into the recording data to be 
recorded actually on the disk. Then, a recorder 232 
records the modulated recording data on the disk 10. 

A standard flow for creating the aforementioned 
disk wiB be described with reference to FIGS. 63 and 
so 64. FIG. 63 shows the flow for creating the logic data to 
be recorded on the disk 10. Specifically, as shown in 
step S230. parameter data Hems, including the number 
of video data files, their arrangement, and the sfre of 
each video data file, are set first. Next, in step S281 
25 video manger 71 is generated from the parameters set 
and the video title set information 281 of each video title 
set 72. In step S282. the video manager 71 and the 
video tile set 71 are arranged in the order mentioned, 
according to their logic block numbers, thereby generat- 
30 ing logic data which is to be recorded on the disk 10. 

Thereafter, the flow for creating the physical data to 
bo recorded on the disk as shown in FIG. 64 is exe- 
cuted. Specifically, as shown in step S283. the togc 
data is divided into units of a specific number of bytes, 
35 thereby forming error correction data. Next, as shown in 
step S284, the logic data divided into units of a specific 
nurrfcer of bytes are mixed with the created error correc- 
tion data to form physical sectors. Thereafter, as shown 
in step S285, physical data is created by combining 
40 physical sectors. In this way. the modulating process 
based on certain rules is performed on the physical data 
created In the flow of FIG. 64. thereby forming the 
recording data. Thereafter, the recording data is 
recorded on the disk 10. 
45 The above-descrtoed data structure can be applied 
not only to a case where the data is recorded on record- 
ing mediums, such as optical disks, and then the cfisks 
are distributed to the users, but also to a communication 
system as shown in FIG. 65. Specifically, according to 
so the procedure shown in FIGS. 59 to 62, an optical disk 
10 in which a video manager 71 and video title set 72 as 
shown in FIG. 4 may be loaded into a reproducing unit 
300, from whose system CPU section 50 the encoded 
data is taken out digitally and transmitted by a modula- 
55 tor/transmitter 310 to the users or the cable subscribers 
by radio or via a cable. Furthermore, the encoding sys- 
tem 320 shown in FIGS. 59 and 62 may create the dat3 
encoded on the provider side, such as a broadcasting 
station and the encoded data may be transmitted by the 
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modulator/transmitter 310 to the users or the cable sub- 
scribers by radio or via a cable. In such a communica- 
tion system, the information in the video manager 71 is 
modulated at the modulator/transmitter 310 and then 
supplied to or is directly: supplied to the users free of 
charge. When a user is interested in the title, the modu- 
lator/transmitter 310 transmits the title set 72 at the 
user's or subscriber's request by radio or via a cable. 
Under the control of the. video manager 71, the video 
titte set information 94 is first transferred and then the 
title video object 95 in the video title set reproduced 
according to the title set informaition 94 is transferred. At 
this time, if necessary, the video title set menu video 
object 95 is also transmitted. The transferred data is 
received by a receiver/demodulator 400 oh the user 
side and is processed as encoded data at the system 
CPU section 50 of the reproducing unit on the U6er or 
subscriber side of FK3; 1 in the same manner as in the 
above-described reproducing process, whereby the 
video data is reproduced. 

- :j In transferring the video title set 72, the video object 
sets 95, 96 are transferred using the video object unit 85 
of FIG. 6 as a unit. At the head of the video object unit 
85, an NV pack 86 containing video playback and 
search information is arranged. Furthermore, because 
the NV pack contains the addresse^of the video object 
units to be reproduced immediately before and after the 
video object unit 85 to which the NV pack 86 belongs, 
even if the video object unit 85 is lost during transfer for 
some reason, the video object can be reproduced relia- 
bly on the user side by requesting the lost video object 
unit 85 .to be transmitted again. Furthermore, even if 
transfers not carried out in the order of playback of 
video object units, because the system ROM/RAM sec- 
tion 52 on the user side holds the accurate playback 
information on program chains, the system CPU section 
50 can specify the order of playback referring to the 
address data in its NV pack. 



Claims 



A recording medium characterized by comprising: 
a plurality of data units recorded thereon, 
I which become objects to be reproduced in a time 
sequential manner, each object being reproduced 
i within a given time period; 

- each of said data units . constituted of a 
;| } stream of a plurality of data packs and playback 
i time information, said data packs containing pack- 
f ets of reproduction 'data including at least one of 
:; I audio data, video data and sub-picture data; 
; j said time information (PTS) of that data unit 
l which includes a sub-picture being later by a prede- 
-> termined time than time Information (PTS) of that 

• data unit which includes audio data or video data; 
1 ' i|; reproduction data of said data unit inctucJng 

* said sub-picture being reproduced after reproduc- 
;■ tion of reproductiondata of said data unit including 

said audio data or video data. 



2. A recording medium according to claim ^charac- 
terized in that said audio data and sub-picture are 
of a same language. 

5 3. A recording apparatus tor recording reproduction 
: data on a recording medium (10), characterized by 

comprising: 

means for generating a plurality of data 
packs and playback time information (PTS), said 
io data packs containing packets of reproduction data 
including at least one of audio data, video data and 

sub-picture data; 

means for preparing a plurality of data units 

Including playback time Information (PTS) and hav- 
15 ing a stream of data packs to be reproduced within 
a given time period as a unit; and 

means for recording said data units on said 
* recording medium (10) in a time-sequentially repro- 
ducible manner, 
20 : time information (PTS) of that data unit 

which includes a sub-picture to be reproduced 
within said given time period being later by a prede- 
termined time than time information (PTS) of that 
data unit which includes audio data or video data to 
25 be reproduced within said given time period. 

4. A recording apparatus according to claim 3, charac- 
terized In that 6aid audio data and sub-picture are 
of a same language. 

30 

5. A method of recording reproduction data on a 
recording medium (10), characterized by compris- 
ing the steps of: 

generating a plurality of data packs contain- 

35 ing packets of reproduction data including at least 
one of audio data, video data and sub-picture data; 

preparing a plurality of data units including 
playback time information (PTS) and having a 
stream of data packs to be reproduced within a 
40 given time period as a unit; and 

recording said data units on said recording 
medium (10) in a time-sequentially reproducible 
manner, 

time information (PTS) of that data unit 
as which includes a sub-picture to be reproduced 
within said given time period being later by a prede- 
termined time than time information (PTS) of that 
data unit which includes audio data or video data to 
be reproduced within said given time period. 

so 

6. A method according to claim 5, characterized in 
that said audio data and sub-picture are of a same 
language. 

55 7. A reproducing apparatus for reproducing reproduc- 
tion data from a recording medium (10), character- 
ized by comprising: 

means (30, 50. 52, 54, 56) for acquiring, 
from said recording medium (10), a plurality of data 
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units recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted ; of a 
stream of a plurality of data packs and playback 5 
time information; said data packs containing pack- 
ets of reproduction data including at least one of 
audio data, video data and sub-picture data, ; 

time Information (PTS) of that data' unit 
which includes a sub-picture to be reproduced 10 
within a given time period being later by a predeter- 
mined time than time Information (PTS) of that data 
unit which includes audio data or video data to be 
reproduced within said given time period; and 

means for converting said data unit of said 13 
acquired reproduction data to a reproduction signal 
in accordance with said time information (PTS) 
included in said data unit and reproducing said 
reproduction signal. j j 

whereby after reproduction data of that data 20 
unit which includes audio data or video data to be 
reproduced within a given itime period is repro- 
duced, said reproducing means reproduces repro- 
duction data of said data unit including said sub- 
picture to be reproduced within 6aid given period. 25 

■ I • 

8. A reproducing apparatus according to claim 7. 
characterized in that after reproduction data of said 
data unit including audio data and reproduction 
data of said data unit including video data are 30 
simultaneously reproduced,' reproduction data of 
said data unit including a sub-picture is reproduced, 
and reproduction data of said data unit including 
audio data and reproduction data of said data unit 
including video data are simultaneously reproduced $s 
again after reproduction of said reproduction data 

of said data unit including said sub-picture is conv 
pleted. 

9. A reproducing apparatus according' to claim 7, 40 
characterized In that when; a predetermined time 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 45 
including a sub-picture is reproduced while said 
reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, so 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced: 

■ j. ! ; 55 

10. A reproducing apparatus according to claim 7, 
characterized in that while reproduction data of said 
data unit including video data is being reproduced 
at a predetermined point of time, reproduction data 



of said data unit including a sub-picture is repro- 
. duced, and when reproduction of said reproduction 
data of said data unit including said sub-picture is 
completed, reproduction data of said data unit 
including audio data and reproduction data of sad 
data unit including video data, both data being 
associated with that point of time, are simultane- 
ously reproduced. 

11. A reproducing apparatus according to claim 7, 
characterized in that when a predetermined time 
elapses after reproduction data of sad data unit 
including video data and reproduction data of sad 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data vtii 
including audio data is reproduced while sad repro- 
duction data of said data unit including video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including sad audio data is completed, repro- 
duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced 

12. A reproducing apparatus according to daim 7, 
characterized in that said aucf 0 data and sad suc»- 
picture are of a same language. 

13. A method of reproducing reproduction data from a 
recording medium (10), characterized by compris- 
ing the steps of: 

acquiring (30, 50, 52. 54, 56). from sad 
recording mecfium (10), a plurality of data units 
recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of sad data units being constituted of a 
stream of a plurality of data packs and payback 
time information (PTS). sad data packs containing 
packets of reproduction data induing at least one 
of audio data, vdeo data and sub-picture data. 

time information (PTS) of that data unit 
which includes a sub-picture to be reproduced 
within a given time period being later by a predeter- 
mined time than time information (PTS) of that data 
unit which includes audio data or video data to bo 
reproduced within sad given time period; and 

converting sad data unit of said reproduc- 
tion data to a reproduction signal in accordance 
with sad time information (PTS) induded in sad 
data unit and reprodudng sad reproduction signal. 

whereby after reproduction data cf that data 
unit which includes audio data or video data to be 
reproduced within a given time period is repro- 
duced, reproduction data of sad data unit inducing 
sad sub-picture to be reproduced within sad given 
period is reproduced. 
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14! A reproducing method according to claim 13, char- 

• r acterized in that after reproduction data of said data 
■! 1 unit including audio data and reproduction data of 
V"; said data unit including video data are simultane- 
: : Vously reproduced, reproduction data of said data 
J unit including a sub-picture is reproduced, and , 

\ reproduction data of said data unit including audio 
{ data 1 and reproduction data of said data unit includ- 

• k ing video data are ; simultaneously reproduced 
• . ■ : ?" again after reproduction of said reproduction data 

• ; of said data unit including said sub-picture is com- 
.; I pleted. ; [ 

is! A reproducing method according to claim 13, char- 
acterized in that when a predetermined time 
; { elapses after reproduction data of said data unit 
: i I including audio data and reproduction data of said 

• ? data unit including Video data are simultaneously 
! ' reproduced, reproduction data of said data unit 

Y including a sub-picture is reproduced while said 
S reproduction data of said data unit including video 
1 data at that point of time is kept reproduced, and 
• when reproduction of said reproduction data of said 
I data unit including said sub-picture is completed. 
) reproduction data oi said data unit including audio 

I i data and reproduction data of said data unit includ- 
i ing video data, both data being associated with that 

- \ point of time, are simultaneously reproduced. 



16. A reproducing method according to claim 13, char- 
acterized in that while reproduction data of said 

] data unit including video data is being reproduced 
; ; t at a predetermined point of time, reproduction data 
r of said data unit including a sub-picture is repro- 

V duced, and when reproduction of said reproduction 
• ) data of said data unit inducing said sub-picture is 

• completed, reproduction data of said data unit 
f including audio data and reproduction data of said 

ri data unit including'' video data, both date being 

V associated with that point of time, are 6imultane- 
£ ously reproduced. | 

17. A reproducing method according to claim 13, char- 
• : ; acterized in that when a predetermined time 

vi \ elapses after reproduction data of said data unit 

* including video data and reproduction data of said 
( data unit including a sub-picture are simultaneously 
f reproduced, reproduction data of said data unit 
■•; including audio data is reproduced while said repro- 
i duction data of said data unit Including video data at 
I that point of time is kept reproduced, and when 

reproduction of said reproduction data of said data 
: unit including said audio data is completed, repro- 
/ i duction data of said data unit including audio data 
j y and reproduction data of said data unit including 
- ; video data, both data being associated with that 
k point of time, are simultaneously reproduced. 



18. A reproducing method according to claim 13, char- 
acterized in that said audio data and said sub-pic- 
ture are of a same language. 

5 19. A reproducing apparatus for reproducing reproduc- 
tion data from a recording medium (10), character- 
ized by comprising: 

means (30, 50, 52, 54. 56) for acquiring, 
from said recording medium (10), a plurality of data 

10 units recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a . 
stream of a plurality of data packs and playback 

T5 time information (PTS).sakJ data packs containing 
packets of reproduction data including at least one 
of audio data, video data and sub-picture data; and 
means for converting said data unit of said 
acquired reproduction data to a reproduction signal 

so in accordance with said time information (PIS) 

included in said data unit and reproducing said 

reproduction signal, 

whereby after reproduction data of that data 

unit which includes audio data or video data to be 
25 : reproduced within a given time period is repro- 
duced, said reproducing means reproduces repro- 
duction data of said data unit including said sub- 
picture to be reproduced within said given period 
when a predetermined time previously set elapses. 

30 

20. A reproducing apparatus according to claim 19, 
characterized in that after reproduction data of said 
data unit Including audio data and reproduction 
data of said data unit including video data are 

35 simultaneously reproduced, reproduction data of 
said data unit including a sub-picture is reproduced, 
and reproduction data of said data unit including 
audio data and reproduction data of said data unit 
including video data are simultaneously reproduced 
40 again after reproduction of said reproduction data 
of said data unit Including said sub-picture is com- 
pleted. 

21, A reproducing apparatus according to claim 19, 
45 characterized In that when a predetermined time 

elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 
so including a sub-picture is reproduced while said 
reproduction data of said data unit including video 

data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, 
55 reproduction data of said data unit including audio 
. data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced. 
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22. A reproducing apparatus according to claim' 19. 
characterized in that while reproduction data of said 
data unit including video data is being reproduced 
at a predetermined point of time, reproduction data 
of said data unit including a sub-picture is repro- 
duced, and when reproduction of said reproduction 
data of said data unit including said sub-picture is 
completed, reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data, both data being 
associated with that point of time, are simultane- 
ously reproduced. 

'I : 

23. A reproducing apparatus according to daim 19. 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
including audio data is reproduced while 6akJ repro- 
duction data of said data unit including video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including said audio data is completed, repro- 
duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced, j 



10 



I 

24. A reproducing apparatus according to claim 19, 
characterized in that said audio data and said sub- 
picture are of a same language. 

:" ' i ■ ! ' s • 

25. A method of reproducing reproduction data from a 
recording medium (10). characterized by compris- 
ing the steps of : ; | i • ! 

acquiring (30, 50, 52. 54. 56), from said 
recording medium (10), a plurality of data units 
recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and playback 
time information (PTS). said data packs containing 
packets of reproduction data including at least one 
of audio data, video data and sub-picture data; and 

converting (57, 58, 60, 62) said data unit of 
said reproduction data to a : reproduction signal in 
accordance with said time information (PTS) 
included in said data unit .and reproducing said 
reproduction signal, j- j 

whereby after reproduction data of that data 
unit which includes at least one of audio data and 
video data to be reproduced within a given time 
period is reproduced, reproduction data of said 
data unit including said sub-picture to be repro- 
duced within said given period is reproduced when 
a predetermined time previously set eiapses. j 



26. A reproducing method accorcfing to daim 25. char- 
acterized in that after reproduction data cf said data 
unit including audio data and reproduction data of 
said data unit including video data are simultane- 
ously reproduced, reproduction data of said data 
unit including a sub-picture is reproduced, and 
reproduction data of said data unit inducfing audio 
data and reproduction data of said data unit includ- 
ing video data are simultaneously reproduced 
again after reproduction of said reproduction data 
of said data unit including said sub-picture is com- 
pleted. 



27. A reproducing method according to daim 25. char* 
15 acterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit inducfing video data are simultaneously 
reproduced, reproduction data of said data unit 
to induding a suto-picture is reproduced while said 
reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit inducfing said sub-picture is completed, 
25 reproduction data of said data unit induding audio 
data and reproduction data of said data unit indud- 
ing video dat3, both data being associated with that 
point of time, are simultaneously reproduced 

30 28. A reproducing method accorcfing to daim 25, char* 
acteri2ed in that while reproduction data of said 
data init including video data is being reproduced 
at a predetermined point of time, reproduction data 
of said data unit including a sub-picture is repro- 

35 duced. and when reproduction of said reproduction 
data of said data unit induding said sub-picture is 
corrpleted. reproduction data of said data unit 
induding audio data and reproduction data of said 
data unit induding video data, both data being 

40 assodated with that pdnt of time, are simultane- 
ously reproduced. 

29. A reprodudng method accorcfing to daim 25. char- 
acterized in that when a predetermined time 

45 elapses after reproduction data of said data unit 
induding video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
induding audio data is reproduced while said repro- 

$o duction data of said data unit induding video data at 
that pdnt of time is kept reproduced, and when 
reproduction of said reproduction data of sad data 
unit including said audio data is completed, repro- 
duction data of said data unit induding audio data 

55 and reproduction data of said data unit Induding 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 
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31. 



32. 



33. 
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30.' A reproducing method according to claim 25, char- 
i acterlzed in that 8aid audio data and said sub-pic- 
: • ture are of a same language. • 

A reproducing apparatus for reproducing reproduc- 
tion data from a recording medium (10), character- 
ized by comprising: | 

' means (30, 50. 52, 54, 56) for acquiring, 
from said recording medium (10), a plurality of data 
units recorded thereon, which become obj eds to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and playback 
time information (PTS), said data packs containing 
packets of reproduction data including at least one 
of audio data, video data and sub-picture data; 

: means (4) tor setting a delay time (Td) at 
which reproduction -data of that data unit which 
includes a sub-picture to be reproduced within a 
given time period after reproduction data of that 
data unit which includes audio data or video data to 
be reproduced within said given time period is 
reproduced; and : j ; 

means (57, 58, 60, 62) for converting said zs 
data unit of said acquired reproduction data to a 
reproduction signal in accordance with said time 
information (PTS) included in said data unit and 
reproducing said reproduction signal, 

!•; whereby after reproduction data of that data 
unit which includes at least one of audio data and 
video data to be reproduced within a given time 
period is reproduced, said reproducing means 
reproduces reproduction data of said data unit 
including said si*>-picture to be reproduced within 
said given period when said set delay time (Td) 
elapses. j 
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A reproducing apparatus according to claim 31, 
characterized in that after reproduction data of said 
data unit Including' audio data and reproduction 
data of "said data Unit including video data are. 
simultaneously reproduced, reproduction data of 
said data unit including a sub-picture is reproduced, 
and reproduction data of said data unit including 
audio data and reproduction data of said data unit 
including yideo data are simultaneously reproduced 
again after reproduction of said reproduction data 
of said data unit including 6aid sub-picture is com- 
pleted. 1 

A reproducing apparatus according to claim 31, 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 
reproduction data of said data unit including video 
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data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced. 

34. A reproducing apparatus according to claim 31, 
characterized in that while reproduction data of said 
data unit including video data is being reproduced 
at a predetermined point of time, reproduction data 
of said data unit including a sub-picture is repro- . 
duced, and when reproduction of said reproduction 
data of said data unit including said sub-picture is 

. completed, reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data, both data being : 
associated with that point of time, are simultane- 
ously reproduced. 

35. A reproducing apparatus according to claim 31, 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
including audio data is reproduced while said repro- 
duction data of said data unit including video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including said audio data is completed, repro- 
duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 

36. A reproducing apparatus according to ctaim 31, 
characterized in that said audio data and said sub- 
picture are of a same language. 

37. A reproducing apparatus according to claim 31, 
characterized In that said sub-picture is displayed 
as if hidden by a mosaic pattern or black filling for a 
delay period. 

38. A method of reproducing reproduction data from a 
recording medium (10), characterized by compris- 
ing the 6teps of : * 

acquiring (30, 50, 52, 54, 56), from said 
recording medium (10), a plurality of data units 
recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
. object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and playback 
time information (PTS), said data packs containing 
packets of reproduction data including at least one 
of audio data, video data and sub-picture data; ; 
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setting (4) a delay time (Td) at which repro- 
duction data of that data unit which includes a sub- 
picture to be reproduced within a given time period 
after reproduction data of ihat data; unit which 
includes audio data or video data to be reproduced $ 
within said given time period is reproduced; and 

converting (57, 58, 60, 62) said data unit of 
said reproduction data to a reproduction signal in 
accordance with said time information (PTS) 
included In said data unit and reproducing said 10 
reproduction signal, j 

whereby after reproduction data ol that data 
unit which includes at least one of audio data and 
video data to be reproduced within a given time 
period is reproduced, reproduction data of said js 
data unit including said 6ub-picture to be repro- 
duced within said given period is reproduced when 
said set delay time (Td) elapses. 

I : 5 - 

39. A reproducing method according to claim 38, char- 20 
acterized in that after reproduction data of said data 
unit including audio data and reproduction data of 
said data unit including video data are simultane- 
ously reproduced, reproduction data of said data 
unit including a sub-picture is reproduced, ; and 25 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data are simultaneously reproduced 
again after reproduction of said reproduction data 

of said data unit including said sub-picture is com- so 
pleted. i ' \ : ■ j 

40. A reproducing method according to claim 38, char- 
acterized in that when a predetermined time 
elapses after reproduction data of said data' unit 35 
including audio data and reproduction data of said 
data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 
reproduction data of said data unit including video 40 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 45 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced. \ 

. ; i. ; ! 

41. A reproducing method according to claim 38, char- 
acterized in that while reproduction data of said so 
data unit including video data is being reproduced 

at a predetermined point of time, reproduction, data 
of said data unit including a sub-picture is repro- 
duced/and when reproduction of said reproduction 
data of said data unit including said sub-picture is 55 
completed, reproduction data of said data unit 
including audio data and reproduction data o1 said 
data unit including video data, both data being 
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associated with that point of time, are simultane- 
ously reproduced. 

42. A reproducing method accorcfing to darm 38. char- 
acterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including video data and reproduction data of sad 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
including audio data is reproduced while said repro- 
duction data of said data unit including video data at 
that point of time Is kept reproduced, and when 
reproduction of said reproduction data erf said data 
unit including said audio data is completed, repro- 
duction data of said data unit including audio data 
and reproduction data of said data unil including 
video data, both data being associated with that 
point of time, are simultaneously reproduced 

43. A reproducing method according b claim 38. char- 
acterized in that said audio data and said siA>-pic- 
ture are of a same language. 

44. A reproducing method accorcfing to claim 38. char- 
acterized in that said sub-pictue is displayed as if 
hidden by a mosaic pattern or Uack tiling for a 
delay period. 

45. A reproducing apparatus for reproducing reproduc- 
tion data from a recording medium (10). character- 
ized by comprising: I 

means (30. 50, 52, 54, 56) tor acting, 
from said recording medium (1 0), a plurality of data 
units recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and playback 
time information (PTS), sad data packs containing 
packets of reproduction data inducing at least one 
of audio data, video data and sub-picture data, 

said time information (PTS) of that data urit 
which includes a sub-picture consisting of a play- 
back start time (PTS) and playback stop time 
(PTS); 

means (57) for computing a delay time of 
said data unit including said sub-picture from sad 
playback start time (PTS) and playback stop time 
(PTS) recorded in said data unit including said sti>- 
picture of said acquired reproduction data; and 

means (57 # 58. 60. 62) tor converting said 
data unit of said acquired reproduction data to a 
reproduction signal in accordance with said time 
information (PTS) included in said data unit and 
reproducing said reproduction signal, 

whereby after reproduction data of that data 
unit which includes at least one of audio data and 
video data to be reproduced within a given time 
period is reproduced, sakJ reproducing means 
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reproduces reproduction data of said data unit 
: including said sub-picture to be reproduced within. 
- said given period when said computed delay time 

\\. jelapses.. . ! 

• ■ " : ■ :: .:■ - : . . • ' * V ; • s 
46.:' A reproducing apparatus according to ciaim 46, 
f characterized in that after reproduction data of said 
: data: unit including audio data and reproduction 
/data of said data unit including video data are ; 
; simultaneously reproduced, reproduction data of io 
: : ^ said data unit including a sub-picture is reproduced, 
: • and reproduction data of said data unit including 
■ r audio data and reproduction data of said data unit 
. 2 Including video data are simultaneously reproduced 
; . again after reproduction of said reproduction data 75 
: i of said data unit including said sub-picture is com- 
peted. -: '.;=]. 



47. A reproducing apparatus according to claim 45, 
characterized in that when a predetermined time 20 . 

felapses after reproduction data of said data unit 
: . 3 Including audio data and reproduction data of said 
1 data unit including video data are simultaneously 
•reproduced,' reproduction data of said data unit 
■ inclining a sub-picture is produced while said 25 
: ' reproduction data of said data unit including video 
.• \ data at that point of time is kept reproduced, and 
. I j • when reproduction of said reproduction data of said 
: - data unit including said sub-picture is completed, 
.. j ■ reproduction data of said data unit including audio 30 

: data and reproduction data of said data unit includ- 
- : % ing video data, both data being associated with that 
\ point of time, are simultaneously reproduced. 

48. A reproducing apparatus according to claim 45, 35 
.; : characterized in that while reproduction data of said 

r data unit including video data is being reproduced 
i :! at a predetermined point of time, reproduction data 
V. of said data unit including a 6ub-picture is repro- 
: duced, and when reproduction of said reproduction 40 
: data of said data unit Including said sub-picture is 
; completed, reproduction data of said data unit 
7 including audio data and reproduction data of said 
/ data unit including j video data, both data being 
j associated with that point of time, are simultane- 45 
' ; ■ oubly reproduced/ \ 

49. A reproducing apparatus according to claim 45, 
.•■ characterized in that when a predetermined time 

; elapses after reproduction data of said data unit so 
; Including video data and reproduction data of said 
J data unit including a sub-picture are simultaneously 
, :: reproduced, reproduction data of said data unit 
; including audio data is reproduced while said repro- . 
; : duction data of said data unit including video data at 55 

that point of time is kept reproduced, and when 
: i reproduction of said reproduction data of said data 
: unit including said audio data Is completed, repro- 
diictioh data of 6aid data unit including audio data 



and reproduction data of said data unit inctuding 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 

50. A reproducing apparatus according to claim 45, 
characterized in that said audio data and said sub- 
picture are of a same language. 

51. A reproducing apparatus according to claim 45, 
characterized in that said sub-picture is displayed . 
as if hidden by a mosaic pattern or black fining for a . 
delay period. 

52. A method of reproducing reproduction data from a 
recording medium (1 0). characterized by compris- 
ing the steps of: 

acquiring (30, 50, 52, 54, 56), from said 
recording medium (10), a plurality of data units 
recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and playback 
time information (PTS). said data packs containing 
packets of reproduction data including at least one 
of audio data, video data and sub-picture data, 

computing (57) a delay time (Td) at which 
reproduction data of said data unit including said 
sub-picture from a playback start time (PTS) and 
playback stop time (PTS) recorded in said data unit 
. including said sub-picture of acquired reproduction 
data; and 

converting (57, 58, 60, 62) said data unit of 
said reproduction data to a reproduction signal in 
accordance with said time information (PTS) 
included in said data unit and reproducing said 

! reproduction signal, 

whereby after reproduction data of that data 
unit which includes at least one of audio data and 

: video data to be reproduced within a given time 
period is reproduced, reproduction data of said 
data unit including said sub-picture to be repro- 
duced within said given period is reproduced when 
said computed delay time elapses. 

53. A reproducing method according to claim 52, char- 
. acterized in that after reproduction data of said data 

unit including audio data and reproduction data of 
said data unit including video data are simultane- 
ously reproduced, reproduction data of said data 
unit including a sub-picture is reproduced, and 
reproduction data of said data unit including audio 
data and reproduction data of 6aid data unit inctud- 
ing video data are simultaneously reproduced 
again after reproduction of said reproduction data 
of said data unit including said sii>-picture is com- 
pleted... . 
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54. A reproducing method according to claim 52, char- 
acterized in that when a' predetermined :tme 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said ■ 
data unit including video data are simultaneously s 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 
reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said w 
data unit including said sub-picture is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced, i is 

. \ r. ; ; ; 

55. A reproducing method according to claim 52, char* : 
acterized in that while reproduction data of said 
data unit including video data is being reproduced 

at a predetermined point of time, reproduction data 20 
of said data unit including a sub-picture is repro- * 
duced, and when reproduction of said reproduction 
data of said data unit including said sub-picture is 
completed, reproduction data of said data unit 
including audio data and reproduction data of said 25 
data unit including video data, both data being ; 
associated with that point of time, are simultane- 
ously reproduced. 1 

56. A reproducing method according to claim 52, char- 30 
acterized in that when a predetermined time 
elapses after reproduction idata of said data unit 
including video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of sad data unit 35 
including audio data is reproduced while said repro- 
duction data of said data unit including video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including said audio data is completed, repro- 40 
duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 

|- ; 45 

57. A reproducing method according to clam 52, char- 
acterized in that said audio data and said sub-pic- 
ture are of a same language. 

58. A reproducing method according to claim 52, char- so 
acterized in that said sub-picture is displayed as H 
hidden by a mosaic pattern or black filling for a 
delay period. 1 I- ..." ■ 

59. A reproducing apparatus characterized by compris- 55 
ing: 1 1 ! 

reading means (30, 50, 52, 54, 56) for read- 
ing a main picture data unit consisting of a stream 
of packs of at least one main picture data for repro- 



ducing a main picture, an audio data unit consisting 
of a stream of packs of at least one audio data 
reproducible in a same time slot as said main pic- 
ture data unit, and a sub-picture data unit consisting 
of a stream of packs of at least one sub-picture data 
reproduce after a predetermined time after repro- 
duction of at least one of sad main picture data unit 
and said audio data unit; 

first control means (57. 58. 60) for converting 
at least one of said main picture data unit and audio 
data unit read by said rearing means (30, 50. 52, 
54. 56). to a reproduction output; and 

second control means (57, 62) for converting 
said sub-picture data unit, read by said reading 
means (30. 50, 52. 54, 56). to a reproduction output 
after conversion of at least one of said main picture 
data unit and audio data unit to said reproduction 
output by said f irst control means (57, 58, 60). 

60. A reproducing apparatus according to daim 59. 
characterized in that after reproduction data of said 
data unit including audio data and reproduction 
data of said data unit induding video data are 
simultaneously reproduced, reproduction data of 
said data unit induding a sub-picture is reproduced, 
and reproduction data of said data unit induding 
audio data and reproduction data of sad data unit 
induding video data are simultaneously reproduced 
again after reproduction of sad reproduction data 
of sad data unit induding sad sub-pdure is com- 
pleted. 

61. A reproducing apparatus according to daim 59, 
chamderized in that when a predetermined time 
elapses after reproduction data of sad data unit 
induding audio data and reproduction data of sad 
data unit induding vdeo data are simuttanecusly 
reproduced, reproduction data of said data unit 
inducing a sub-picture is reproduced while sad 
reproduction data of sa?d data unit induding vdeo 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of sad 
data unit inducfing sad sub-picture is completed, 
reproduction data of sad data unit Inducing audio 
data and reproduction data of sad data unit indud- 
ing vdeo data, both data being assodated with that 
point of time, are simultaneously reproduced. 

62. A reprodudng apparatus according to daim 59, 
charaderized in that while reproduction data of sad 
data unit induding vdeo data is being reproduced 
at a predetermined point erf time, reproduction data 
of sad data urit induding a sub-picture is repro- 
duced, and when reproduction of sad reproduction 
data ol sad data unit including sad sub-picture is 
completed, reproduction data of sad data unit 
induding audio data and reproduction data of sad 
data unit induding video data, both data being 



associated with that 
ously reproduced. 
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point of time, are simultane- 



63^ A reproducing apparatus according to claim 59, 
f characterized in that when a predetermined time 
•'•v elapses after reproduction data of said data unit 
: including video data and reproduction data of said 
. f data unit including a sub-picture are simultaneously 
:; : reproduced, reproduction data of said data unit 
1 including audio data is reproduced while said repro- 
[ duction data of said data unit including video data at 
• v that point of time is kept reproduced, and when 
) reproduction of said reproduction data of said data " 
; I. unit Including said audio data is completed, repro- 
t duction data of said data unit including audio data: 
' and reproduction data of said data unit including 
■i video data, both data being associated with that 
?• point of time, are simultaneously reproduced. 

64. A reproducing apparatus according to daim 59, 
,: ■? characterized in that said audio data and said 6ub- 
: picture are of a same language. 



65. A producing apparatus characterized by compris- 

v reading means (30. 50. 52, 54, 56) for read- 
j ing a main picture data unit consisting of a stream 
i J of packs of at least one main picture data for repro- 
ducing a main picture, an audio data unit consisting 
: '•• of a stream of packs of at least one audio data 
■j reproducible in a salme time slot as said main pic- 
- ture data unit, and a sub-picture data unit consisting 
* of a stream of packs of at least one sub-picture data 
? reprbduciWe in said same time slot as said main 

i; picture data unit; ] 

■ first control means (57, 58, 60) for converting 

\ at least one of said main picture data unit and audio 

I data unit read by said reading means (30, 50, 52, 

i 54, 56), to a reproduction output; and 

: { i ■'. second control means (57, 62) for converting 
said sub-picture data unit, read by said reading 

; ] means (30, 50, 52, 54, 56), to a reproduction output 

} when a predetermined time previously set elapses 

= } after conversion of at least one of said main picture 

: data unit and audio data unit to said reproduction 

j output by said first control means (57, 58, 60). 

66. A reproducing apparatus according to" claim 65, 
? characterized in that after reproduction data of said 

data unit Including audio data and reproduction 

v data of said data;unit including video data are 

•i\ simultaneously reproduced, reproduction data of 

; said data unit including a sub-picture is reproduced, 

: ! ; and reproduction data of said data unit including 

]: audio data and reproduction data of said data unit 

■'• t including video data are simultaneously reproduced 

. i again after reproduction of said reproduction data 

\ of said data unit including said sub-picture is com- 

:k j pleted. } 



67. A reproducing apparatus according to claim 65, 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said 

5 data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 
. reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 

10 when reproduction of said reproduction data of said 
. data unit including said sub-picture is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 

is point of time, are simultaneously reproduced. 

68. A reproducing apparatus according to claim 65. 
characterized in that while reproduction data of said 
data unit including video data is being reproduced 

20 at a predetermined point of time, reproduction data 
of said data unit including a sub-picture is repro- 
duced, and when reproduction of said reproduction 
. data of said data unit including said sub-picture is 
completed, reproduction data of said data unit 
25 including audio data and reproduction data of said 
data unit including video data, both data being 
associated with that point of time, are simultane- 
ously reproduced. 

$0 69. A reproducing apparatus according to claim 65, 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
35 reproduced, reproduction data of said data unit 
including audio data is reproduced while said repro- 
duction data of said data unit including video data at 
V that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
40 unit including said audio data is completed, repro- 
; duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 



45 

70. A reproducing apparatus according to claim 65, 
characterized in that said audio data and said sub- 
picture are of a same language. 

so 71. A reproducing apparatus characterized by compris- 
ing: 

reading means (30, 50, 52, 54, 56) for read- 
ing a main picture data unit consisting of a stream 
of packs of at least one main picture data for repro- 
55 . ; ducing a main picture, an audio data unit consisting 
of a stream of packs of at least one audio data 
reproducible in a same time slot as said main pic- 
ture data unit, and a 6ub-picture data unit consisting 
of a stream of packs of at least one sub-picture data 
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reproducible after a predetermined time after repro- 
duction of at least one of said main picture data unit 
and said audio data unit; | 

. setting means (4) for; setting a delay time 
(Td) at which said sub-picture data unit is repro- 
duced after reproduction of at least one of said 
main picture data unit and audio data unit; 

first control means (57, 58. 60} for converting 
at least one of said main picture data unit and audio 
data unit, read by said reading means (30, 50. 52, 
54, 56), to a reproduction output; and ; 

second control means (57, 62) for converting 
said sub-picture data unit read by said reading 
means (30. 50, 52, 54, 56), td a reproduction output 
when said delay time (Td) set by said setting means 
(4) elapses after conversion of at least one of said 
main picture data unit and audio data unit to said 
reproduction output by said first control means (57, 
62). 

72, A reproducing apparatus according to claim 71, 
characterized in that after reproduction data of said 
data unit including audio data and reproduction 
data of said data unit including video data are 
simultaneously reproduced, reproduction data of 
said data unit including a sub-picture is reproduced, 
and reproduction data of said data unit including 
audio data and reproduction data of said data unit 
including video data are simultaneously reproduced 
again after reproduction of said reproduction data 
of said data unit including said sub-picture is com- 
pleted. 1 

73- A reproducing apparatus according to daim 71, 
characterized in that when a predetermined time 
elapses after reproduction ftota of said data unit 
including audio data and reproduction data of said 
data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 
reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said dab unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced. 1 

• : I ! ! 

74. A reproducing apparatus according to daim 71, 
characterized in that while reproduction data of said 
data unit including video data is being reproduced 
at a predetermined point of time, reproduction data 
of 6aid data unit induding a sub-picture is repro- 
duced, and when reproduction of sad reproduction 
data of said data unit induding said sub-picture is 
completed, reproduction data of said data unit 
including audio data and reproduction data of said 
data unit induding video data, both data being 



assodated with that point of time, are simultane- 
ously reproduced. 

75. A reproducing apparatus according to daim 71, 
5 characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
induding video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
io induding audio data is reproduced while said repro- 
duction data of said data unit induding video data at 
that point of time is kept reproduced, and vtfien 
reproduction of said reproduction data of said data 
unit including said audio data te completed, repro- 
r5 duction data of said data unit induding audio data 
and reproduction data of said data unit induJing 
video data, both data being associated with that 
point of time, are simultaneously reproduced 

20 7$. A reproducing apparatus according to daim 71, 
characterized in that said aucfio data and tad ui> 
pidure are of a same language. 

77. A reprodudng apparatus according to daim 71, 
25 chararterized in that said sub-picture is dsptayed ; 

as if hidden by a mosaic pattern or black filling lor a 
delay period. 

78. A reproducing apparatus charaderized by compris- 
so ing: 

reading means (30. 50. 52, 54. 56) fer read- 
ing a main pidure data unit consisting of a stream 
of packs of at least one main picture data for repro- 
dudng a main picture, an audio data unit consisting 

35 of a stream of packs of at least one autfo data 
reproducible in a same time slot as said main pic- 
ture data unit and a sub-picture data unit consisting 
of a stream of packs of at least one sub-picture data 
reproducible after a predetermined time after r epro- 

40 duction of at least one of said main picture data unit 
. and said audio data unit, a playback start time 
{PIS) and playback stop time (PTS) being recorded 
in said sii^picture data unit; 

means (57) for computing a delay time (Td) 

45 of said sub-picture data unit from said playback 
start time (PTS) and playback stop time (PTS) in 
said sub-picture data unit, read by said reading 
means (30. 50. 52, 54, 56); 

first control means (57, 58, 60) lor converting 

so at least one of said main picture data unit and audb 
data unit read by said reading means (30, 50, 52. 
54. 56), to a reproduction output; and 

second control means (57, 62) for converting 
said sub-picture data unit, read by said reading 

55 means (30. 50. 52, 54. 56). to a reproduction output 
when said delay time (Td) computed by sad com- 
puting means (57) elapses after conversion of at 
least one of said main picture data unit and audio 
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.. : data unit to said reproduction output by said first 
:. •] control means (57, 62). 

79/ A reproducing apparatus according to claim 78, 

j characterized in that after reproduction data of said s . 
. ^ data unit including audio data and reproduction 
H data of said data unit including video data are 
t simultaneously reproduced, reproduction data of 
:!■ : said data unit including a sub-picture is reproduced, 
■ ; and reproduction data of said data unit including 10 

■ audio data and reproduction data of said data unit 
. ! Including video data are simultaneously reproduced 

■ : \ again after reproduction of said reproduction data 
; of said data unit including said sub-picture is com- 
: \ I plated. • t " 15 

' . ' ■ • ■ * ■* 

80. " A reproducing apparatus according to claim 78, 
■;; characterized in that when a predetermined time 

= elapses after reproduction data of said data unit 
: ; y including audio data and reproduction data of said so 

; data unit including video data are simultaneously 
. : reproduced, reproduction data of said data unit 
: ; including a sub-picture is reproduced while said 

• reproductfon data of said data unit including video 

• : data at that point of time is kept reproduced, and : 25 
j I when reproduction of said reproduction data of said 

: : i data unit including said sub-picture is completed. 

i reproduction data of said data unit including audio 
• ■ j" data and reproduction data of said data unit includ- 
f ing video data, both data being associated with that ; 30 - 
i point of time, are simultaneously reproduced. 

81. A reproducing apparatus according to claim 78, 
'* V characterized in that while reproduction data of said 

. : i data unit including video data is being reproduced ss 

• : at a predetermined point of time, reproduction data 

of said data unit including a sub-picture is repro- : 
• duced, and when reproduction of said reproduction 
" data of said data unit including said sub-picture is 
incompleted, reproduction data of said data unit 40 
: \ including audio data and reproduction data of said 
; : data unit Including ; video data, both data being 
\ associated with that point of time, are simuitane- 
- ousiy reproduced/ j 
j-; . • ;■ j . • 45 

82. A reproducing apparatus according to claim 78, 
j characterized in that when a predetermined time 

■ elapses after reproduction data of said data unit 
I including video data and reproduction data of said 

\ data unit including a sub-picture are simultaneously so 

: \ reproduced, reproduction data of 6aid data unit 

) including audio data is reproduced while said repro- 

. ; ; . duction data of said data unit including video data at 

; that pioiht of time is kept reproduced, and when 

■ reproduction of 6akJ ^reproduction data of said data ss 
/ unit including said audio data is completed, repro- 

. duction data of said data unit including audio data 

■ and reproduction data of said data unit including 
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video data, both data being associated with that 
point of time, are simultaneously reproduced. . 

83. A reproducing apparatus according to claim 78, 
characterized in that said audio data and said sub- 
picture are of a same language. 

84. A reproducing apparatus according to claim 78, 
characterized in that said sub-picture is displayed 
as if hidden by a mosaic pattern or black filling for a 
delay period. 
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